00000100:00100000:1.0F:1788836527.973686:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788836527.973721:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8166e97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875730518739712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788836527.973814:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0F:1788836527.973939:0:20219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518739712 00000100:00100000:0.0:1788836527.973953:0:20219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518739712 00000100:00100000:0.0:1788836527.974022:0:20219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788836527.974033:0:20219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f406d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875730518739712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788836527.974063:0:20219:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788836527.974110:0:20219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f406d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875730518739712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836527.974116:0:20219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788836527.974156:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8166e97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875730518739712:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788836527.974231:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0F:1788836527.974644:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788836527.974660:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f405500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875730518739840:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788836527.974695:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836527.974786:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518739840 00000100:00100000:1.0:1788836527.974791:0:18699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518739840 00000100:00100000:1.0:1788836527.974832:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788836527.974839:0:18699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a804769ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875730518739840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788836527.974852:0:18699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788836527.974885:0:18699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a804769ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875730518739840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836527.974891:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1788836527.974940:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788836527.974963:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f405500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875730518739840:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788836527.980280:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f407480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:334968c0-1019-487d-94b4-b0d9e3b864ad:3620:1875730518739968:0@lo:400:kworker.0 00000100:00100000:0.0:1788836527.980356:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836527.980405:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f405180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875730518740480:0@lo:400:kworker.0 00000100:00100000:0.0:1788836527.980433:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836527.980454:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f404a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875730518740992:0@lo:400:kworker.0 00000100:00100000:0.0:1788836527.980505:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836527.980531:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788836527.980536:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f405c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875730518740096:0@lo:400:kworker.0 00000100:00100000:0.0:1788836527.980558:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836527.980575:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f406300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875730518740608:0@lo:400:kworker.0 00000100:00100000:0.0:1788836527.980597:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836527.980615:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f405880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875730518741120:0@lo:400:kworker.0 00000100:00100000:0.0:1788836527.980635:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836527.980665:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518740480 00000100:00100000:0.0:1788836527.980672:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518740480 00000100:00100000:0.0:1788836527.980706:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518740096 00000100:00100000:0.0:1788836527.980709:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518740096 00000100:00100000:0.0:1788836527.980724:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788836527.980744:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166e97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875730518740480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836527.980815:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166e97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875730518740480:12345-0@lo:400:kworker.0 Request processed in 72us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836527.980823:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788836527.980840:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788836527.980847:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166e95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875730518740096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836527.980875:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166e95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875730518740096:12345-0@lo:400:kworker.0 Request processed in 29us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836527.980881:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788836527.980901:0:19980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518740992 00000100:00100000:0.0:1788836527.980904:0:19980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518740992 00000100:00100000:0.0:1788836527.980938:0:19980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518741120 00000100:00100000:0.0:1788836527.980941:0:19980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518741120 00000100:00100000:0.0:1788836527.980960:0:19980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788836527.980967:0:19980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166e96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875730518740992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836527.980996:0:19980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166e96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875730518740992:12345-0@lo:400:kworker.0 Request processed in 30us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836527.981003:0:19980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788836527.981014:0:19980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788836527.981020:0:19980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166e95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875730518741120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836527.981045:0:19980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166e95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875730518741120:12345-0@lo:400:kworker.0 Request processed in 26us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836527.981051:0:19980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788836527.981072:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518740608 00000100:00100000:0.0:1788836527.981075:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518740608 00000100:00100000:0.0:1788836527.981103:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788836527.981110:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166e97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875730518740608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836527.981146:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166e97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875730518740608:12345-0@lo:400:kworker.0 Request processed in 37us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836527.981153:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1788836527.981179:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788836527.981184:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788836527.981186:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788836527.981197:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f404380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875730518740352:0@lo:400:kworker.0 00000100:00100000:0.0:1788836527.981223:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836527.981240:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f407800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875730518740864:0@lo:400:kworker.0 00000100:00100000:0.0:1788836527.981259:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836527.981276:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788836527.981281:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875730518740224:0@lo:400:kworker.0 00000100:00100000:0.0:1788836527.981301:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836527.981319:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f405500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875730518740736:0@lo:400:kworker.0 00000100:00100000:0.0:1788836527.981340:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836527.981354:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8046615500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875730518741248:0@lo:400:kworker.0 00000100:00100000:0.0:1788836527.981373:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836527.981394:0:19082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518740224 00000100:00100000:0.0:1788836527.981398:0:19082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518740224 00000100:00100000:0.0:1788836527.981428:0:19082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788836527.981434:0:19082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166e95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1875730518740224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836527.981488:0:19082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166e95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1875730518740224:12345-0@lo:400:kworker.0 Request processed in 55us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836527.981495:0:19082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788836527.981515:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518740352 00000100:00100000:0.0:1788836527.981519:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518740352 00000100:00100000:0.0:1788836527.981540:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518740864 00000100:00100000:0.0:1788836527.981543:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518740864 00000100:00100000:0.0:1788836527.981554:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518740736 00000100:00100000:0.0:1788836527.981556:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518740736 00000100:00100000:0.0:1788836527.981564:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518741248 00000100:00100000:0.0:1788836527.981566:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518741248 00000100:00100000:0.0:1788836527.981579:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788836527.981584:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166e94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875730518740352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836527.981611:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166e94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875730518740352:12345-0@lo:400:kworker.0 Request processed in 27us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836527.981618:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788836527.981628:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788836527.981634:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166e94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875730518740864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836527.981657:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166e94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875730518740864:12345-0@lo:400:kworker.0 Request processed in 23us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836527.981663:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788836527.981673:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788836527.981678:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166e94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875730518740736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836527.981700:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166e94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875730518740736:12345-0@lo:400:kworker.0 Request processed in 22us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836527.981706:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788836527.981715:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788836527.981720:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166e94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875730518741248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836527.981744:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166e94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875730518741248:12345-0@lo:400:kworker.0 Request processed in 24us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836527.981919:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:0.0:1788836527.981940:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788836527.981948:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788836527.981950:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788836527.981980:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f405c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875730518740096:0@lo:400:kworker.0 00000100:00100000:0.0:1788836527.981992:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f406300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875730518740608:0@lo:400:kworker.0 00000100:00100000:0.0:1788836527.982002:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f405880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875730518741120:0@lo:400:kworker.0 00000100:00100000:0.0:1788836527.982012:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f405180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875730518740480:0@lo:400:kworker.0 00010000:00080000:0.0:1788836527.982025:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a817f404a80 x1875730518740992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836527.982035:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f404a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875730518740992:0@lo:400:kworker.0 00000100:00100000:0.0:1788836527.982068:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875730518740224:0@lo:400:kworker.0 00000100:00100000:0.0:1788836527.982077:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f405500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875730518740736:0@lo:400:kworker.0 00010000:00080000:0.0:1788836527.982085:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a8046615500 x1875730518741248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836527.982093:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8046615500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875730518741248:0@lo:400:kworker.0 00000100:00100000:0.0:1788836527.982101:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f404380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875730518740352:0@lo:400:kworker.0 00000100:00100000:0.0:1788836527.982110:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f407800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875730518740864:0@lo:400:kworker.0 00000100:00100000:1.0:1788836527.983907:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518739968 00000100:00100000:1.0:1788836527.983919:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518739968 00000100:00100000:1.0:1788836527.983974:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788836527.983984:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81446a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:334968c0-1019-487d-94b4-b0d9e3b864ad+24:3620:x1875730518739968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836527.984053:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81446a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:334968c0-1019-487d-94b4-b0d9e3b864ad+24:3620:x1875730518739968:12345-0@lo:400:kworker.0 Request processed in 71us (3696us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836527.984061:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788836527.984106:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f407480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:334968c0-1019-487d-94b4-b0d9e3b864ad:3620:1875730518739968:0@lo:400:kworker.0 00010000:00010000:1.0:1788836528.556485:0:19380:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836528.998808:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8046615500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875730518741376:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788836528.998879:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836528.999958:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518741376 00000100:00100000:3.0:1788836528.999968:0:18698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518741376 00000100:00100000:3.0:1788836529.000019:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788836529.000028:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f407480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875730518741376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788836529.000059:0:18698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788836529.002470:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f407480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875730518741376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2424us (3572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836529.002483:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788836529.011298:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8046615500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875730518741376:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788836529.513329:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788836529.513362:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8048e74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875730518741504:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788836529.513444:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0F:1788836529.513553:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518741504 00000100:00100000:2.0:1788836529.513577:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518741504 00000100:00100000:2.0:1788836529.513664:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788836529.513676:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f407800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875730518741504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788836529.513733:0:17182:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788836529.513814:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f407800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875730518741504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 141us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836529.513823:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788836529.516273:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8048e74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875730518741504:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788836529.522757:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f404380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875730518741632:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788836529.522858:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836529.522962:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518741632 00000100:00100000:0.0:1788836529.522972:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518741632 00000100:00100000:0.0:1788836529.523034:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788836529.523046:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f405500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875730518741632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788836529.523320:0:17182:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1788836529.523381:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f405500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875730518741632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 337us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836529.523389:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788836529.523452:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f404380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875730518741632:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788836529.574588:0:17166:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836530.022734:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8047698a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875730518741760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788836530.022839:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836530.028275:0:20219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518741760 00000100:00100000:0.0:1788836530.028292:0:20219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518741760 00000100:00100000:0.0:1788836530.028388:0:20219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788836530.028402:0:20219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a804769a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875730518741760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788836530.028437:0:20219:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788836530.028593:0:20219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a804769a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875730518741760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 195us (5755us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836530.028602:0:20219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1788836530.028628:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788836530.028686:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8047698a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875730518741760:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1788836530.050138:0:17157:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:3.0:1788836530.050168:0:17157:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a80463869c0 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:3.0:1788836530.050175:0:17157:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a8047259f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a80463866c0 00000020:00080000:3.0:1788836530.050179:0:17157:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a8047259300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a816c1c4400 00010000:00010000:0.0:1788836530.050561:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8141497400/0xbd163c7375715f0e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836530.050592:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8141497400/0xbd163c7375715f0e lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836530.050601:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8141497400/0xbd163c7375715f0e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836530.050608:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8141497400 already unused, calling callback (ffffffffc19ae4f0) 00010000:00010000:0.0:1788836530.050614:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8141497400/0xbd163c7375715f0e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836530.050623:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8141497400/0xbd163c7375715f0e lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836530.050649:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a8164675500) 00010000:00010000:0.0:1788836530.050652:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836530.050658:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8141497400/0xbd163c7375715f0e lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836530.050665:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8141497400/0xbd163c7375715f0e lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17176 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788836530.051518:0:17216:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00000020:00080000:1.0:1788836530.051624:0:17216:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:0.0:1788836530.216180:0:17213:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788836530.216195:0:17213:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788836530.216221:0:17213:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788836530.216235:0:17213:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788836530.601174:0:17165:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836531.074324:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836531.074376:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836531.074408:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836531.074432:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836531.074488:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511313920 00000100:00100000:2.0:1788836531.074500:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511313920 00000100:00100000:2.0:1788836531.074580:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 36 00000100:00100000:2.0:1788836531.074593:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8048e76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee0d308b-6c11-4335-8f83-16d974416bdb+5:2409:x1875730511313920:12345-192.168.201.44@tcp:400:kworker.0 00000100:00100000:2.0:1788836531.074696:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8048e76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee0d308b-6c11-4335-8f83-16d974416bdb+5:2409:x1875730511313920:12345-192.168.201.44@tcp:400:kworker.0 Request processed in 106us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836531.074714:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 36 00000100:00100000:2.0:1788836531.074744:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511313536 00000100:00100000:2.0:1788836531.074748:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511313536 00000100:00100000:2.0:1788836531.074779:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 171 00000100:00100000:2.0:1788836531.074785:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81446a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c451bd85-d8bd-40d7-a376-2671340ce3ab+13:2409:x1875730511313536:12345-192.168.201.44@tcp:400:kworker.0 00000100:00100000:2.0:1788836531.074813:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81446a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c451bd85-d8bd-40d7-a376-2671340ce3ab+13:2409:x1875730511313536:12345-192.168.201.44@tcp:400:kworker.0 Request processed in 28us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836531.074820:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 171 00000100:00100000:2.0:1788836531.074875:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511313664 00000100:00100000:2.0:1788836531.074879:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511313664 00000100:00100000:2.0:1788836531.074921:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511313792 00000100:00100000:2.0:1788836531.074925:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511313792 00000100:00100000:2.0:1788836531.074947:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 83 00000100:00100000:2.0:1788836531.074953:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8048e75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee0d308b-6c11-4335-8f83-16d974416bdb+13:2409:x1875730511313664:12345-192.168.201.44@tcp:400:kworker.0 00000100:00100000:2.0:1788836531.074982:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8048e75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee0d308b-6c11-4335-8f83-16d974416bdb+13:2409:x1875730511313664:12345-192.168.201.44@tcp:400:kworker.0 Request processed in 30us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836531.074989:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 83 00000100:00100000:2.0:1788836531.075001:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 84 00000100:00100000:2.0:1788836531.075007:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8048e77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee0d308b-6c11-4335-8f83-16d974416bdb+5:2409:x1875730511313792:12345-192.168.201.44@tcp:400:kworker.0 00000100:00100000:2.0:1788836531.075030:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8048e77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee0d308b-6c11-4335-8f83-16d974416bdb+5:2409:x1875730511313792:12345-192.168.201.44@tcp:400:kworker.0 Request processed in 24us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836531.075037:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 84 00000100:00080000:2.0:1788836531.075186:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788836531.075191:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788836531.075194:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788836531.077354:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836531.077396:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836531.077418:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836531.077444:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836531.077604:0:19082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511314048 00000100:00100000:3.0:1788836531.077615:0:19082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511314048 00000100:00100000:3.0:1788836531.077683:0:19082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511314432 00000100:00100000:3.0:1788836531.077687:0:19082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511314432 00000100:00100000:3.0:1788836531.077756:0:19082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 31 00000100:00100000:3.0:1788836531.077767:0:19082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a804769b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee0d308b-6c11-4335-8f83-16d974416bdb+5:2407:x1875730511314048:12345-192.168.201.44@tcp:9:kworker.0 00000020:00000080:3.0:1788836531.077807:0:19082:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c7375715c44 00000100:00080000:3.0:1788836531.077827:0:19082:0:(import.c:65:import_set_state_nolock()) ffff9a816c37b800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788836531.077907:0:19082:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1788836531.082768:0:19082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a804769b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee0d308b-6c11-4335-8f83-16d974416bdb+2:2407:x1875730511314048:12345-192.168.201.44@tcp:9:kworker.0 Request processed in 4985us (5409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836531.082787:0:19082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 31 00000100:00100000:3.0:1788836531.082841:0:19082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 32 00000100:00100000:3.0:1788836531.082962:0:19082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8047699f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb7aabf5-9d6a-41ab-bbbe-35969986acd6+5:2407:x1875730511314432:12345-192.168.201.44@tcp:9:kworker.0 00000020:00000080:3.0:1788836531.083008:0:19082:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c7375715c7c 00000100:00080000:3.0:1788836531.083027:0:19082:0:(import.c:65:import_set_state_nolock()) ffff9a816bd7b000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788836531.083163:0:19082:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1788836531.083320:0:19082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8047699f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb7aabf5-9d6a-41ab-bbbe-35969986acd6+2:2407:x1875730511314432:12345-192.168.201.44@tcp:9:kworker.0 Request processed in 470us (5875us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836531.083328:0:19082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 32 00000100:00100000:3.0:1788836531.083367:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511314304 00000100:00100000:3.0:1788836531.083377:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511314304 00000100:00100000:3.0:1788836531.083429:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511314176 00000100:00100000:3.0:1788836531.083433:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511314176 00000100:00100000:3.0:1788836531.083459:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 85 00000100:00100000:3.0:1788836531.083825:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8047699c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb7aabf5-9d6a-41ab-bbbe-35969986acd6+5:2409:x1875730511314304:12345-192.168.201.44@tcp:400:kworker.0 00000100:00100000:3.0:1788836531.085243:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8047699c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb7aabf5-9d6a-41ab-bbbe-35969986acd6+5:2409:x1875730511314304:12345-192.168.201.44@tcp:400:kworker.0 Request processed in 1220us (7645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836531.085259:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 85 00000100:00100000:3.0:1788836531.085299:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 86 00000100:00100000:3.0:1788836531.085321:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8047698700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb7aabf5-9d6a-41ab-bbbe-35969986acd6+6:2409:x1875730511314176:12345-192.168.201.44@tcp:400:kworker.0 00000100:00100000:3.0:1788836531.085364:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8047698700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb7aabf5-9d6a-41ab-bbbe-35969986acd6+6:2409:x1875730511314176:12345-192.168.201.44@tcp:400:kworker.0 Request processed in 48us (7945us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836531.085370:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 86 00000100:00080000:3.0:1788836531.085407:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788836531.085413:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788836531.085418:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788836531.085422:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788836531.085541:0:19379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836531.086919:0:19380:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836531.139294:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836531.139522:0:19082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511314560 00000100:00100000:2.0:1788836531.139537:0:19082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511314560 00000100:00100000:2.0:1788836531.139624:0:19082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 33 00000100:00100000:2.0:1788836531.139636:0:19082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f404380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb7aabf5-9d6a-41ab-bbbe-35969986acd6+5:2407:x1875730511314560:12345-192.168.201.44@tcp:9:kworker.0 00000020:00000080:2.0:1788836531.139687:0:19082:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c7375715c83 00000100:00080000:2.0:1788836531.139708:0:19082:0:(import.c:65:import_set_state_nolock()) ffff9a81646c0800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788836531.139767:0:19082:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00080000:0.0:1788836531.139972:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788836531.139999:0:17166:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836531.140658:0:19082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f404380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb7aabf5-9d6a-41ab-bbbe-35969986acd6+2:2407:x1875730511314560:12345-192.168.201.44@tcp:9:kworker.0 Request processed in 1020us (1377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836531.140690:0:19082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 33 00010000:00010000:2.0:1788836531.624179:0:17165:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836532.354346:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836532.354400:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511314688 00000100:00100000:3.0:1788836532.354412:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511314688 00000100:00100000:3.0:1788836532.354514:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 65 00000100:00100000:3.0:1788836532.354526:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8047699880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee0d308b-6c11-4335-8f83-16d974416bdb+13:15639:x1875730511314688:12345-192.168.201.44@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788836532.354661:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8047699880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee0d308b-6c11-4335-8f83-16d974416bdb+13:15639:x1875730511314688:12345-192.168.201.44@tcp:60:lhsmtool_posix.0 Request processed in 137us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836532.354670:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 65 00000100:00100000:0.0:1788836532.365570:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836532.365702:0:19980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511314816 00000100:00100000:2.0:1788836532.365716:0:19980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511314816 00000100:00100000:2.0:1788836532.365798:0:19980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 66 00000100:00100000:2.0:1788836532.365811:0:19980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f404000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee0d308b-6c11-4335-8f83-16d974416bdb+5:15639:x1875730511314816:12345-192.168.201.44@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788836532.365947:0:19980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f404000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee0d308b-6c11-4335-8f83-16d974416bdb+5:15639:x1875730511314816:12345-192.168.201.44@tcp:60:lhsmtool_posix.0 Request processed in 139us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836532.365956:0:19980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 66 00000100:00100000:0.0:1788836532.381130:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:0.0:1788836532.381191:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511315072 00000100:00100000:0.0:1788836532.381203:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511315072 00000100:00100000:0.0:1788836532.381271:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 12 00000100:00100000:0.0:1788836532.381282:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f404a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee0d308b-6c11-4335-8f83-16d974416bdb+13:15639:x1875730511315072:12345-192.168.201.44@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788836532.381610:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f404a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee0d308b-6c11-4335-8f83-16d974416bdb+14:15639:x1875730511315072:12345-192.168.201.44@tcp:35:lhsmtool_posix.0 Request processed in 328us (495us total) trans 8589934623 rc 0/0 00000100:00100000:0.0:1788836532.381620:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 12 00010000:00010000:3.0:1788836532.648083:0:19379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836533.094191:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8047444380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875730518742272:0@lo:400:kworker.0 00000100:00100000:3.0:1788836533.094418:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836533.094514:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8166d88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875730518742784:0@lo:400:kworker.0 00000100:00100000:3.0:1788836533.094537:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836533.094556:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8166d8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875730518743296:0@lo:400:kworker.0 00000100:00100000:3.0:1788836533.094580:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836533.094607:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1788836533.094613:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f405180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875730518741888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788836533.094647:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836533.094675:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8047444e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875730518742400:0@lo:400:kworker.0 00000100:00100000:3.0:1788836533.094695:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836533.094709:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8166d8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875730518742912:0@lo:400:kworker.0 00000100:00100000:3.0:1788836533.094726:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836533.094744:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8166d89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875730518743424:0@lo:400:kworker.0 00000100:00100000:3.0:1788836533.094762:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836533.094807:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518742272 00000100:00100000:3.0:1788836533.094817:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518742272 00000100:00100000:3.0:1788836533.094877:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518742784 00000100:00100000:3.0:1788836533.094881:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518742784 00000100:00100000:3.0:1788836533.094895:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518742400 00000100:00100000:3.0:1788836533.094898:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518742400 00000100:00100000:3.0:1788836533.094909:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518742912 00000100:00100000:3.0:1788836533.094911:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518742912 00000100:00100000:3.0:1788836533.094926:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788836533.094936:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8047699500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875730518742272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836533.095000:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8047699500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875730518742272:12345-0@lo:400:kworker.0 Request processed in 64us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836533.095008:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788836533.095026:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788836533.095033:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8047698e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875730518742784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836533.095061:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8047698e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875730518742784:12345-0@lo:400:kworker.0 Request processed in 29us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836533.095067:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788836533.095077:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788836533.095083:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a804769b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875730518742400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836533.095121:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a804769b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875730518742400:12345-0@lo:400:kworker.0 Request processed in 38us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836533.095128:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788836533.095138:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788836533.095143:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a804769a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875730518742912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836533.095167:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a804769a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875730518742912:12345-0@lo:400:kworker.0 Request processed in 24us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836533.095172:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788836533.095769:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518741888 00000100:00100000:2.0:1788836533.095777:0:18698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518741888 00000100:00100000:2.0:1788836533.095810:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788836533.095815:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8047699180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875730518741888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788836533.095842:0:18698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788836533.095889:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8047699180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875730518741888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (1241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836533.095895:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788836533.095947:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f405180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875730518741888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788836533.095955:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8047444e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875730518742400:0@lo:400:kworker.0 00000100:00100000:2.0:1788836533.095962:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8166d8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875730518742912:0@lo:400:kworker.0 00000100:00100000:2.0:1788836533.095970:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8047444380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875730518742272:0@lo:400:kworker.0 00000100:00100000:2.0:1788836533.095977:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8166d88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875730518742784:0@lo:400:kworker.0 00000100:00100000:0.0:1788836533.096097:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8046615500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:334968c0-1019-487d-94b4-b0d9e3b864ad:3620:1875730518742016:0@lo:400:kworker.0 00000100:00100000:0.0:1788836533.096134:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836533.096166:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8047444700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875730518742528:0@lo:400:kworker.0 00000100:00100000:0.0:1788836533.096183:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836533.096216:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8166d8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875730518743040:0@lo:400:kworker.0 00000100:00100000:0.0:1788836533.096239:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836533.096257:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8166d88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875730518743552:0@lo:400:kworker.0 00000100:00100000:0.0:1788836533.096274:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836533.096410:0:17170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518742016 00000100:00100000:2.0:1788836533.096423:0:17170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518742016 00000100:00100000:2.0:1788836533.096457:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788836533.096513:0:17170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81446a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:334968c0-1019-487d-94b4-b0d9e3b864ad+24:3620:x1875730518742016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836533.096548:0:17170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81446a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:334968c0-1019-487d-94b4-b0d9e3b864ad+24:3620:x1875730518742016:12345-0@lo:400:kworker.0 Request processed in 37us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836533.096554:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788836533.096597:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8047445500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875730518742144:0@lo:400:kworker.0 00000100:00100000:2.0:1788836533.096628:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836533.096649:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8166d89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875730518742656:0@lo:400:kworker.0 00000100:00100000:2.0:1788836533.096683:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836533.096701:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8166d89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1875730518743168:0@lo:400:kworker.0 00000100:00100000:2.0:1788836533.096721:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836533.096757:0:19980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518743296 00000100:00100000:2.0:1788836533.096761:0:19980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518743296 00000100:00100000:2.0:1788836533.096787:0:19980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518743424 00000100:00100000:2.0:1788836533.096790:0:19980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518743424 00000100:00100000:2.0:1788836533.096805:0:19980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518742528 00000100:00100000:2.0:1788836533.096808:0:19980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518742528 00000100:00100000:2.0:1788836533.096818:0:19980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518743040 00000100:00100000:2.0:1788836533.096820:0:19980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518743040 00000100:00100000:2.0:1788836533.096829:0:19980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518743552 00000100:00100000:2.0:1788836533.096831:0:19980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518743552 00000100:00100000:2.0:1788836533.096843:0:19980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518743168 00000100:00100000:2.0:1788836533.096846:0:19980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518743168 00000100:00100000:2.0:1788836533.096859:0:19980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788836533.096866:0:19980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8047698380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875730518743296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836533.096908:0:19980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8047698380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875730518743296:12345-0@lo:400:kworker.0 Request processed in 42us (2327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836533.096925:0:19980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788836533.096939:0:19980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788836533.096945:0:19980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a804769b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875730518743424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836533.096975:0:19980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a804769b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875730518743424:12345-0@lo:400:kworker.0 Request processed in 31us (2212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836533.096981:0:19980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788836533.096991:0:19980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788836533.096996:0:19980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f405880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875730518742528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836533.097023:0:19980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f405880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875730518742528:12345-0@lo:400:kworker.0 Request processed in 26us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836533.097028:0:19980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788836533.097039:0:19980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788836533.097045:0:19980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f406300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875730518743040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836533.097070:0:19980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f406300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875730518743040:12345-0@lo:400:kworker.0 Request processed in 26us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836533.097075:0:19980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788836533.097085:0:19980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788836533.097091:0:19980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f405c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875730518743552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836533.097116:0:19980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f405c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875730518743552:12345-0@lo:400:kworker.0 Request processed in 26us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836533.097121:0:19980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788836533.097131:0:19980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788836533.097137:0:19980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8048e74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875730518743168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836533.097168:0:19980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8048e74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875730518743168:12345-0@lo:400:kworker.0 Request processed in 31us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836533.097180:0:19980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:2.0:1788836533.097206:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788836533.097211:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788836533.097214:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788836533.097217:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788836533.097247:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8166d89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1875730518743168:0@lo:400:kworker.0 00000100:00100000:0.0:1788836533.097404:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8046615500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:334968c0-1019-487d-94b4-b0d9e3b864ad:3620:1875730518742016:0@lo:400:kworker.0 00000100:00100000:0.0:1788836533.097417:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8047444700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875730518742528:0@lo:400:kworker.0 00000100:00100000:0.0:1788836533.097427:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8166d8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875730518743040:0@lo:400:kworker.0 00010000:00080000:0.0:1788836533.097440:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a8166d88000 x1875730518743552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836533.097451:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8166d88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875730518743552:0@lo:400:kworker.0 00000100:00100000:0.0:1788836533.097500:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518742144 00000100:00100000:0.0:1788836533.097505:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518742144 00000100:00100000:0.0:1788836533.097539:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518742656 00000100:00100000:0.0:1788836533.097542:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518742656 00000100:00100000:0.0:1788836533.097556:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788836533.097562:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8048e76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875730518742144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836533.097611:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8048e76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875730518742144:12345-0@lo:400:kworker.0 Request processed in 49us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836533.097618:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788836533.097630:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788836533.097636:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8048e75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875730518742656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836533.097672:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8048e75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875730518742656:12345-0@lo:400:kworker.0 Request processed in 27us (979us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836533.097679:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788836533.097709:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8047445500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875730518742144:0@lo:400:kworker.0 00000100:00100000:0.0:1788836533.097719:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8166d89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875730518742656:0@lo:400:kworker.0 00000100:00100000:1.0:1788836533.099397:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788836533.099423:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8166d88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875730518743680:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788836533.099536:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836533.100045:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518743680 00000100:00100000:0.0:1788836533.100055:0:18699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518743680 00000100:00100000:0.0:1788836533.100125:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788836533.100135:0:18699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166d89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875730518743680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788836533.100166:0:18699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788836533.100248:0:18699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166d89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875730518743680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 114us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836533.100257:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788836533.102022:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8166d88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875730518743680:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788836533.102167:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8166d89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875730518743424:0@lo:400:kworker.0 00010000:00080000:2.0:1788836533.102259:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a8166d8b480 x1875730518743296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836533.102273:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8166d8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875730518743296:0@lo:400:kworker.0 00010000:00010000:2.0:1788836533.670143:0:19380:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836534.118660:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788836534.118698:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8166d88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875730518743808:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788836534.118803:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836534.118960:0:20219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518743808 00000100:00100000:3.0:1788836534.118973:0:20219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518743808 00000100:00100000:3.0:1788836534.119068:0:20219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788836534.119082:0:20219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f405180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875730518743808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788836534.119124:0:20219:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788836534.119197:0:20219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f405180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875730518743808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 117us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836534.119205:0:20219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788836534.119543:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8166d88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875730518743808:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788836534.631376:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788836534.631413:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8046615500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875730518743936:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788836534.631555:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836534.631627:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518743936 00000100:00100000:3.0:1788836534.631647:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518743936 00000100:00100000:3.0:1788836534.631714:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788836534.631724:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8047698000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875730518743936:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788836534.631768:0:17182:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1788836534.631833:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8047698000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875730518743936:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836534.631860:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788836534.631933:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8046615500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875730518743936:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788836534.632578:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8048e74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875730518744064:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788836534.632649:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836534.636926:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518744064 00000100:00100000:3.0:1788836534.636952:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518744064 00000100:00100000:3.0:1788836534.637061:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788836534.637075:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166d88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875730518744064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788836534.637128:0:17182:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788836534.637260:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166d88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875730518744064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 189us (4611us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836534.637269:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788836534.637427:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8048e74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875730518744064:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788836534.696803:0:17166:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836535.143823:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788836535.143855:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a804769aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875730518744192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788836535.143947:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836535.144090:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518744192 00000100:00100000:2.0:1788836535.144101:0:18698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518744192 00000100:00100000:2.0:1788836535.144186:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788836535.144199:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166d8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875730518744192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788836535.144228:0:18698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788836535.144287:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166d8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875730518744192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836535.144296:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788836535.144352:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a804769aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875730518744192:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788836535.144706:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1788836535.656682:0:17157:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:3.0:1788836535.656700:0:17157:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:1.0:1788836535.656764:0:17216:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:1.0:1788836535.656777:0:17216:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00010000:00010000:2.0:1788836535.718015:0:17165:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788836535.785952:0:17943:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788836536.174366:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836536.174417:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836536.174429:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511315200 00000100:00100000:1.0:1788836536.174440:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511315200 00000100:00100000:2.0:1788836536.174489:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836536.174518:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836536.174527:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 173 00000100:00100000:1.0:1788836536.174540:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81446a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c451bd85-d8bd-40d7-a376-2671340ce3ab+13:2408:x1875730511315200:12345-192.168.201.44@tcp:400:kworker.0 00000100:00100000:2.0:1788836536.174568:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836536.174622:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511315584 00000100:00100000:3.0:1788836536.174628:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511315584 00000100:00100000:1.0:1788836536.174634:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81446a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c451bd85-d8bd-40d7-a376-2671340ce3ab+13:2408:x1875730511315200:12345-192.168.201.44@tcp:400:kworker.0 Request processed in 94us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836536.174644:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 173 00000100:00100000:0.0:1788836536.174656:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511315456 00000100:00100000:0.0:1788836536.174663:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511315456 00000100:00100000:1.0:1788836536.174687:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511315712 00000100:00100000:1.0:1788836536.174693:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511315712 00000100:00100000:0.0:1788836536.174707:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511315328 00000100:00100000:0.0:1788836536.174712:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511315328 00000100:00100000:1.0:1788836536.174722:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 93 00000100:00100000:1.0:1788836536.174732:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8048e77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee0d308b-6c11-4335-8f83-16d974416bdb+5:2408:x1875730511315456:12345-192.168.201.44@tcp:400:kworker.0 00000100:00100000:0.0:1788836536.174740:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 94 00000100:00100000:0.0:1788836536.174751:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8048e76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb7aabf5-9d6a-41ab-bbbe-35969986acd6+6:2408:x1875730511315712:12345-192.168.201.44@tcp:400:kworker.0 00000100:00100000:3.0:1788836536.174853:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 41 00000100:00100000:3.0:1788836536.174864:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8048e74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee0d308b-6c11-4335-8f83-16d974416bdb+5:2408:x1875730511315584:12345-192.168.201.44@tcp:400:kworker.0 00000100:00100000:2.0:1788836536.175701:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836536.176218:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8048e77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee0d308b-6c11-4335-8f83-16d974416bdb+5:2408:x1875730511315456:12345-192.168.201.44@tcp:400:kworker.0 Request processed in 1484us (1798us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836536.176228:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 93 00000100:00100000:1.0:1788836536.176250:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511315840 00000100:00100000:1.0:1788836536.176264:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511315840 00000100:00100000:1.0:1788836536.176355:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 95 00000100:00100000:1.0:1788836536.176363:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8048e75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee0d308b-6c11-4335-8f83-16d974416bdb+13:2408:x1875730511315328:12345-192.168.201.44@tcp:400:kworker.0 00000100:00100000:1.0:1788836536.176404:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8048e75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee0d308b-6c11-4335-8f83-16d974416bdb+13:2408:x1875730511315328:12345-192.168.201.44@tcp:400:kworker.0 Request processed in 42us (1886us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836536.176411:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 95 00000100:00100000:1.0:1788836536.176424:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 96 00000100:00100000:1.0:1788836536.176431:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8048e77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb7aabf5-9d6a-41ab-bbbe-35969986acd6+5:2408:x1875730511315840:12345-192.168.201.44@tcp:400:kworker.0 00000100:00100000:1.0:1788836536.176453:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8048e77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb7aabf5-9d6a-41ab-bbbe-35969986acd6+5:2408:x1875730511315840:12345-192.168.201.44@tcp:400:kworker.0 Request processed in 24us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836536.176474:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 96 00000100:00080000:1.0:1788836536.176544:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788836536.176549:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788836536.176552:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788836536.180094:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8048e76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb7aabf5-9d6a-41ab-bbbe-35969986acd6+6:2408:x1875730511315712:12345-192.168.201.44@tcp:400:kworker.0 Request processed in 5331us (5620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836536.180110:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 94 00000100:00100000:3.0:1788836536.180141:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8048e74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee0d308b-6c11-4335-8f83-16d974416bdb+5:2408:x1875730511315584:12345-192.168.201.44@tcp:400:kworker.0 Request processed in 5276us (5569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836536.180152:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 41 00000001:00100000:3.0:1788836536.682187:0:19511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of eb7aabf5-9d6a-41ab-bbbe-35969986acd6 00000020:00000080:3.0:1788836536.682197:0:19511:0:(genops.c:885:class_export_put()) final put ffff9a81646c7000/eb7aabf5-9d6a-41ab-bbbe-35969986acd6 00000001:00100000:3.0:1788836536.682227:0:19511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ee0d308b-6c11-4335-8f83-16d974416bdb 00000020:00000080:3.0:1788836536.682230:0:19511:0:(genops.c:885:class_export_put()) final put ffff9a8046225000/ee0d308b-6c11-4335-8f83-16d974416bdb 00000001:00100000:0.0:1788836536.682329:0:18691:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of eb7aabf5-9d6a-41ab-bbbe-35969986acd6 00000020:00000080:0.0:1788836536.682334:0:18691:0:(genops.c:885:class_export_put()) final put ffff9a8046129000/eb7aabf5-9d6a-41ab-bbbe-35969986acd6 00000020:00000080:1.0:1788836536.682395:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a81646c7000/eb7aabf5-9d6a-41ab-bbbe-35969986acd6 for lustre-OST0001 00000020:00000080:1.0:1788836536.682445:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a8046225000/ee0d308b-6c11-4335-8f83-16d974416bdb for lustre-OST0001 00000020:00000080:1.0:1788836536.682482:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a8046129000/eb7aabf5-9d6a-41ab-bbbe-35969986acd6 for lustre-OST0000 00000020:00000080:1.0:1788836536.682501:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a81646c0800 for lustre-OST0001 00000020:00000080:1.0:1788836536.682506:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a816c37b800 for lustre-OST0001 00000020:00000080:1.0:1788836536.682509:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a816bd7b000 for lustre-OST0000 00010000:00010000:3.0:1788836536.748149:0:19379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836537.766455:0:19380:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836538.213716:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788836538.213752:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8166d8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875730518744320:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788836538.213832:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836538.213909:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518744320 00000100:00100000:0.0:1788836538.213917:0:18699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518744320 00000100:00080000:1.0:1788836538.214055:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788836538.214676:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8048e75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875730518744576:0@lo:400:kworker.0 00000100:00100000:2.0:1788836538.214722:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836538.214765:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8048e74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875730518745088:0@lo:400:kworker.0 00000100:00100000:2.0:1788836538.214797:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836538.214814:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8047444e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875730518745600:0@lo:400:kworker.0 00000100:00100000:2.0:1788836538.214836:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836538.214855:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788836538.214860:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8048e77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875730518744704:0@lo:400:kworker.0 00000100:00100000:2.0:1788836538.214881:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836538.214898:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8047445500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875730518745216:0@lo:400:kworker.0 00000100:00100000:2.0:1788836538.214916:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836538.214931:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f535f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875730518745728:0@lo:400:kworker.0 00000100:00100000:2.0:1788836538.214950:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836538.215647:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788836538.215661:0:18699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8046615500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875730518744320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788836538.215693:0:18699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788836538.215736:0:18699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8046615500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875730518744320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (1904us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836538.215742:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788836538.215826:0:19082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518744704 00000100:00100000:2.0:1788836538.215832:0:19082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518744704 00000100:00100000:2.0:1788836538.215872:0:19082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518745216 00000100:00100000:2.0:1788836538.215874:0:19082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518745216 00000100:00100000:2.0:1788836538.215890:0:19082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788836538.215895:0:19082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f535880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1875730518744704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836538.215926:0:19082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f535880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1875730518744704:12345-0@lo:400:kworker.0 Request processed in 31us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836538.215933:0:19082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788836538.215943:0:19082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788836538.216026:0:19082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f534e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875730518745216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836538.216054:0:19082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f534e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875730518745216:12345-0@lo:400:kworker.0 Request processed in 30us (1136us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836538.216059:0:19082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1788836538.216081:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788836538.216109:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8048e77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875730518744704:0@lo:400:kworker.0 00000100:00100000:2.0:1788836538.216120:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8047445500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875730518745216:0@lo:400:kworker.0 00000100:00100000:2.0:1788836538.216165:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518744576 00000100:00100000:2.0:1788836538.216169:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518744576 00000100:00100000:2.0:1788836538.216187:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518745088 00000100:00100000:2.0:1788836538.216189:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518745088 00000100:00100000:2.0:1788836538.216202:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788836538.216208:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f534a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875730518744576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836538.216257:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f534a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875730518744576:12345-0@lo:400:kworker.0 Request processed in 49us (1534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836538.216264:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788836538.216275:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788836538.216281:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f537100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875730518745088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836538.216305:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f537100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875730518745088:12345-0@lo:400:kworker.0 Request processed in 24us (1507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836538.216310:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788836538.216331:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8048e76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:334968c0-1019-487d-94b4-b0d9e3b864ad:3619:1875730518744448:0@lo:400:kworker.0 00000100:00100000:2.0:1788836538.216357:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836538.216381:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8048e74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875730518744960:0@lo:400:kworker.0 00000100:00100000:2.0:1788836538.216401:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836538.216423:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8047444380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875730518745472:0@lo:400:kworker.0 00000100:00100000:2.0:1788836538.216440:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836538.216486:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8166d8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875730518744320:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788836538.216499:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788836538.216504:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8048e75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875730518744832:0@lo:400:kworker.0 00000100:00100000:2.0:1788836538.216523:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836538.216536:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8047444700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875730518745344:0@lo:400:kworker.0 00000100:00100000:2.0:1788836538.216551:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836538.216560:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f534700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875730518745856:0@lo:400:kworker.0 00000100:00100000:2.0:1788836538.216585:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836538.216605:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518744448 00000100:00100000:2.0:1788836538.216608:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518744448 00000100:00100000:2.0:1788836538.216631:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788836538.216637:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81446a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:334968c0-1019-487d-94b4-b0d9e3b864ad+24:3619:x1875730518744448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836538.216664:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81446a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:334968c0-1019-487d-94b4-b0d9e3b864ad+24:3619:x1875730518744448:12345-0@lo:400:kworker.0 Request processed in 27us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836538.216669:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788836538.216692:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518745600 00000100:00100000:2.0:1788836538.216695:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518745600 00000100:00100000:2.0:1788836538.216715:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518745728 00000100:00100000:2.0:1788836538.216718:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518745728 00000100:00100000:2.0:1788836538.216727:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518744960 00000100:00100000:2.0:1788836538.216729:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518744960 00000100:00100000:2.0:1788836538.216737:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518745472 00000100:00100000:2.0:1788836538.216739:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518745472 00000100:00100000:2.0:1788836538.216748:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518745344 00000100:00100000:2.0:1788836538.216749:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518745344 00000100:00100000:2.0:1788836538.216757:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518745856 00000100:00100000:2.0:1788836538.216764:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518745856 00000100:00100000:2.0:1788836538.216778:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788836538.216783:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f536680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875730518745600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836538.216808:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f536680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875730518745600:12345-0@lo:400:kworker.0 Request processed in 25us (1971us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836538.216813:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788836538.216822:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788836538.216829:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f537800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875730518745728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836538.216847:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f537800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875730518745728:12345-0@lo:400:kworker.0 Request processed in 19us (1896us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836538.216853:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788836538.216861:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788836538.216866:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f536d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875730518744960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836538.216883:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f536d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875730518744960:12345-0@lo:400:kworker.0 Request processed in 18us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836538.216889:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788836538.216896:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788836538.216901:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f535500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875730518745472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836538.216917:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f535500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875730518745472:12345-0@lo:400:kworker.0 Request processed in 17us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836538.216922:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788836538.216931:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788836538.216936:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f535c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875730518745344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836538.217097:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518744832 00000100:00100000:3.0:1788836538.217102:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518744832 00000100:00100000:3.0:1788836538.217129:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788836538.217136:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f537480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875730518744832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836538.217625:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f535c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875730518745344:12345-0@lo:400:kworker.0 Request processed in 687us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836538.217643:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788836538.217659:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788836538.217665:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f534000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875730518745856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836538.221275:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f535f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875730518745728:0@lo:400:kworker.0 00000100:00100000:3.0:1788836538.221446:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f537480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875730518744832:12345-0@lo:400:kworker.0 Request processed in 4307us (4917us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836538.221476:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1788836538.221537:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788836538.221544:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788836538.221548:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788836538.221572:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8166d8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875730518745984:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788836538.221659:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836538.221702:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8048e75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875730518744832:0@lo:400:kworker.0 00000100:00100000:3.0:1788836538.221716:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8047444700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875730518745344:0@lo:400:kworker.0 00000100:00100000:2.0:1788836538.222083:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f534000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875730518745856:12345-0@lo:400:kworker.0 Request processed in 4415us (5504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836538.222093:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788836538.222139:0:20219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518745984 00000100:00100000:2.0:1788836538.222146:0:20219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518745984 00000100:00100000:2.0:1788836538.222188:0:20219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788836538.222196:0:20219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a804769bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875730518745984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788836538.222222:0:20219:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788836538.222261:0:20219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a804769bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875730518745984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836538.222268:0:20219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788836538.223942:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8048e75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875730518744576:0@lo:400:kworker.0 00000100:00100000:0.0:1788836538.223967:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8048e74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875730518745088:0@lo:400:kworker.0 00010000:00080000:0.0:1788836538.223982:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a8047444e00 x1875730518745600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836538.224014:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8047444e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875730518745600:0@lo:400:kworker.0 00010000:00080000:3.0:1788836538.227124:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a817f534700 x1875730518745856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836538.227144:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f534700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875730518745856:0@lo:400:kworker.0 00000100:00100000:3.0:1788836538.227159:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8048e76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:334968c0-1019-487d-94b4-b0d9e3b864ad:3619:1875730518744448:0@lo:400:kworker.0 00000100:00100000:3.0:1788836538.227331:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8048e74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875730518744960:0@lo:400:kworker.0 00000100:00100000:3.0:1788836538.227354:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8047444380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875730518745472:0@lo:400:kworker.0 00000100:00100000:3.0:1788836538.227416:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8166d8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875730518745984:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788836538.791623:0:17166:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836539.242232:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788836539.242258:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f534380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875730518746112:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788836539.242329:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836539.242366:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518746112 00000100:00100000:3.0:1788836539.242372:0:18699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518746112 00000100:00100000:3.0:1788836539.242405:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788836539.242410:0:18699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a804769aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875730518746112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788836539.242435:0:18699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788836539.242482:0:18699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a804769aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875730518746112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836539.242488:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788836539.242520:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f534380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875730518746112:0@lo:13:osp-pre-0-1.0 00000001:02000400:2.0:1788836539.280295:0:20570:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 23:02:18 (1788836538) 00000100:00100000:1.0:1788836539.751719:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788836539.751741:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f535180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875730518746240:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788836539.751821:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836539.752010:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518746240 00000100:00100000:2.0:1788836539.752029:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518746240 00000100:00100000:2.0:1788836539.752096:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788836539.752108:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166d89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875730518746240:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788836539.752142:0:17183:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788836539.752195:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166d89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875730518746240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836539.752202:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788836539.752248:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f535180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875730518746240:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788836539.752508:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875730518746368:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788836539.752540:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836539.752638:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518746368 00000100:00100000:1.0:1788836539.752642:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518746368 00000100:00100000:1.0:1788836539.752664:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788836539.752679:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a816bd76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875730518746368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788836539.752710:0:17182:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1788836539.752752:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a816bd76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875730518746368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836539.752758:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788836539.752931:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875730518746368:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788836539.813659:0:17165:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836540.261933:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788836540.261955:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875730518746496:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788836540.262019:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836540.262060:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518746496 00000100:00100000:0.0:1788836540.262076:0:18698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518746496 00000100:00100000:0.0:1788836540.262120:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788836540.262128:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a816bd75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875730518746496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788836540.262149:0:18698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788836540.262194:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a816bd75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875730518746496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836540.262201:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788836540.262250:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875730518746496:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788836540.262703:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1788836540.456154:0:17213:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788836540.456174:0:17213:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788836540.456196:0:17213:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788836540.456203:0:17213:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788836540.843137:0:19379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836541.302211:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836541.302265:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836541.302294:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836541.302312:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836541.302330:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836541.302354:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836541.302381:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511316224 00000100:00100000:1.0:1788836541.302391:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511316224 00000100:00100000:1.0:1788836541.302440:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511316480 00000100:00100000:1.0:1788836541.302443:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511316480 00000100:00100000:1.0:1788836541.302454:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511316096 00000100:00100000:1.0:1788836541.302456:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511316096 00000100:00100000:1.0:1788836541.302495:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511316608 00000100:00100000:1.0:1788836541.302497:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511316608 00000100:00100000:1.0:1788836541.302514:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 103 00000100:00100000:1.0:1788836541.302531:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166d88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee0d308b-6c11-4335-8f83-16d974416bdb+5:2408:x1875730511316224:12345-192.168.201.44@tcp:400:kworker.0 00000100:00100000:1.0:1788836541.302606:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166d88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee0d308b-6c11-4335-8f83-16d974416bdb+5:2408:x1875730511316224:12345-192.168.201.44@tcp:400:kworker.0 Request processed in 83us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836541.302613:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 103 00000100:00100000:1.0:1788836541.302629:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 104 00000100:00100000:1.0:1788836541.302635:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166d88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb7aabf5-9d6a-41ab-bbbe-35969986acd6+6:2408:x1875730511316480:12345-192.168.201.44@tcp:400:kworker.0 00000100:00100000:1.0:1788836541.302674:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166d88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb7aabf5-9d6a-41ab-bbbe-35969986acd6+6:2408:x1875730511316480:12345-192.168.201.44@tcp:400:kworker.0 Request processed in 39us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836541.302680:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 104 00000100:00100000:1.0:1788836541.302693:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 105 00000100:00100000:1.0:1788836541.302699:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166d8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee0d308b-6c11-4335-8f83-16d974416bdb+13:2408:x1875730511316096:12345-192.168.201.44@tcp:400:kworker.0 00000100:00100000:1.0:1788836541.302720:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166d8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee0d308b-6c11-4335-8f83-16d974416bdb+13:2408:x1875730511316096:12345-192.168.201.44@tcp:400:kworker.0 Request processed in 22us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836541.302726:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 105 00000100:00100000:1.0:1788836541.302738:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 106 00000100:00100000:1.0:1788836541.302743:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb7aabf5-9d6a-41ab-bbbe-35969986acd6+5:2408:x1875730511316608:12345-192.168.201.44@tcp:400:kworker.0 00000100:00100000:1.0:1788836541.302766:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb7aabf5-9d6a-41ab-bbbe-35969986acd6+5:2408:x1875730511316608:12345-192.168.201.44@tcp:400:kworker.0 Request processed in 22us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836541.302771:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 106 00000100:00100000:1.0:1788836541.302796:0:18697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511316352 00000100:00100000:1.0:1788836541.302799:0:18697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511316352 00000100:00100000:1.0:1788836541.302836:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 45 00000100:00100000:1.0:1788836541.303174:0:18697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166d8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ee0d308b-6c11-4335-8f83-16d974416bdb+5:2408:x1875730511316352:12345-192.168.201.44@tcp:400:kworker.0 00000100:00100000:1.0:1788836541.303232:0:18697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166d8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ee0d308b-6c11-4335-8f83-16d974416bdb+5:2408:x1875730511316352:12345-192.168.201.44@tcp:400:kworker.0 Request processed in 387us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836541.303239:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 45 00000100:00080000:1.0:1788836541.303264:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788836541.303270:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788836541.303272:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788836541.303856:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511315968 00000100:00100000:3.0:1788836541.303863:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511315968 00000100:00100000:3.0:1788836541.303919:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 175 00000100:00100000:3.0:1788836541.303927:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81446a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c451bd85-d8bd-40d7-a376-2671340ce3ab+13:2408:x1875730511315968:12345-192.168.201.44@tcp:400:kworker.0 00000100:00100000:3.0:1788836541.303967:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81446a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c451bd85-d8bd-40d7-a376-2671340ce3ab+13:2408:x1875730511315968:12345-192.168.201.44@tcp:400:kworker.0 Request processed in 41us (1766us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836541.303974:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 175 00010000:00010000:2.0:1788836541.861676:0:19380:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836542.887269:0:17166:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836543.333818:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788836543.333852:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8166d8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875730518746624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788836543.333922:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836543.334081:0:20219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518746624 00000100:00100000:0.0:1788836543.334089:0:20219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518746624 00000100:00100000:0.0:1788836543.334160:0:20219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788836543.334171:0:20219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8047698a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875730518746624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788836543.334212:0:20219:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788836543.334257:0:20219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8047698a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875730518746624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836543.334265:0:20219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1788836543.334653:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788836543.334735:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8166d8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875730518746624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788836543.335034:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8166d8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875730518746752:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788836543.335072:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836543.335383:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518746752 00000100:00100000:1.0:1788836543.335397:0:18699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518746752 00000100:00100000:1.0:1788836543.335455:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788836543.335483:0:18699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a816bd77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875730518746752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788836543.335509:0:18699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788836543.335551:0:18699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a816bd77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875730518746752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836543.335557:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788836543.335591:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8166d8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875730518746752:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788836543.335757:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a81412e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875730518747264:0@lo:400:kworker.0 00000100:00100000:3.0:1788836543.335790:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836543.335824:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a81412e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1875730518747776:0@lo:400:kworker.0 00000100:00100000:3.0:1788836543.335856:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836543.335874:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788836543.335879:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a81412eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875730518747136:0@lo:400:kworker.0 00000100:00100000:3.0:1788836543.335905:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836543.335922:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a81412e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875730518747648:0@lo:400:kworker.0 00000100:00100000:3.0:1788836543.335943:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836543.335960:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a81412e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1875730518748160:0@lo:400:kworker.0 00000100:00100000:3.0:1788836543.335980:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836543.336004:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518747264 00000100:00100000:3.0:1788836543.336008:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518747264 00000100:00100000:3.0:1788836543.336540:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518747776 00000100:00100000:3.0:1788836543.336544:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518747776 00000100:00100000:3.0:1788836543.336560:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518747648 00000100:00100000:3.0:1788836543.336563:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518747648 00000100:00100000:3.0:1788836543.336575:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518748160 00000100:00100000:3.0:1788836543.336579:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518748160 00000100:00100000:3.0:1788836543.336594:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788836543.336602:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81412ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875730518747264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836543.336658:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81412ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875730518747264:12345-0@lo:400:kworker.0 Request processed in 56us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836543.336665:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788836543.336677:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788836543.336683:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81412e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875730518747776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836543.336722:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81412e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875730518747776:12345-0@lo:400:kworker.0 Request processed in 40us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836543.336729:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788836543.336742:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788836543.336748:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81412e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875730518747648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836543.336775:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81412e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875730518747648:12345-0@lo:400:kworker.0 Request processed in 28us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836543.336781:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788836543.336793:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788836543.336798:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81412e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875730518748160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836543.336825:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81412e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875730518748160:12345-0@lo:400:kworker.0 Request processed in 27us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836543.336841:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788836543.336869:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518747136 00000100:00100000:3.0:1788836543.336872:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518747136 00000100:00100000:3.0:1788836543.336902:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788836543.336909:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81412e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875730518747136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836543.336937:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81412e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875730518747136:12345-0@lo:400:kworker.0 Request processed in 30us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836543.336943:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788836543.336986:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a81412eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875730518747136:0@lo:400:kworker.0 00000100:00100000:3.0:1788836543.336996:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a81412e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875730518747648:0@lo:400:kworker.0 00010000:00080000:3.0:1788836543.337008:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a81412e8e00 x1875730518748160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788836543.337129:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788836543.337135:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788836543.337137:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788836543.337139:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788836543.337502:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a81412eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:334968c0-1019-487d-94b4-b0d9e3b864ad:3618:1875730518746880:0@lo:400:kworker.0 00000100:00100000:1.0:1788836543.337550:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836543.337603:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a81412ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875730518747392:0@lo:400:kworker.0 00000100:00100000:1.0:1788836543.337630:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836543.337650:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a81412ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875730518747904:0@lo:400:kworker.0 00000100:00100000:1.0:1788836543.337671:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836543.337692:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788836543.337698:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a81412eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875730518747008:0@lo:400:kworker.0 00000100:00100000:1.0:1788836543.337719:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836543.337735:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a81412ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875730518747520:0@lo:400:kworker.0 00000100:00100000:1.0:1788836543.337758:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836543.337777:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a81412e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875730518748032:0@lo:400:kworker.0 00000100:00100000:1.0:1788836543.337799:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836543.337842:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518747392 00000100:00100000:1.0:1788836543.337847:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518747392 00000100:00100000:1.0:1788836543.337873:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518747008 00000100:00100000:1.0:1788836543.337875:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518747008 00000100:00100000:1.0:1788836543.337888:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788836543.337907:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166d8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875730518747392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836543.337951:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166d8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875730518747392:12345-0@lo:400:kworker.0 Request processed in 45us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836543.337958:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788836543.337972:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788836543.337978:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166d89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875730518747008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836543.338005:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166d89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875730518747008:12345-0@lo:400:kworker.0 Request processed in 27us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836543.338321:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788836543.338343:0:18697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518747520 00000100:00100000:1.0:1788836543.338347:0:18697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518747520 00000100:00100000:1.0:1788836543.338379:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788836543.338385:0:18697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166d88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875730518747520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836543.338419:0:18697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166d88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875730518747520:12345-0@lo:400:kworker.0 Request processed in 35us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836543.338425:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788836543.338456:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a81412eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875730518747008:0@lo:400:kworker.0 00000100:00100000:1.0:1788836543.338507:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a81412ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875730518747520:0@lo:400:kworker.0 00000100:00100000:1.0:1788836543.338516:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a81412ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875730518747392:0@lo:400:kworker.0 00000100:00100000:1.0:1788836543.338543:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518747904 00000100:00100000:1.0:1788836543.338546:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518747904 00000100:00100000:1.0:1788836543.338578:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518748032 00000100:00100000:1.0:1788836543.338580:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518748032 00000100:00100000:1.0:1788836543.338597:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788836543.338602:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166d89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875730518747904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836543.338646:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166d89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875730518747904:12345-0@lo:400:kworker.0 Request processed in 43us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836543.338652:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788836543.338664:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788836543.338669:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166d8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875730518748032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836543.338692:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166d8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875730518748032:12345-0@lo:400:kworker.0 Request processed in 23us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836543.338697:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788836543.338725:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a81412e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875730518748032:0@lo:400:kworker.0 00010000:00080000:1.0:1788836543.338737:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a81412ea680 x1875730518747904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836543.338746:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a81412ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875730518747904:0@lo:400:kworker.0 00000100:00100000:0.0:1788836543.339135:0:17170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518746880 00000100:00100000:0.0:1788836543.339140:0:17170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518746880 00000100:00100000:0.0:1788836543.339188:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788836543.339363:0:17170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81446a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:334968c0-1019-487d-94b4-b0d9e3b864ad+24:3618:x1875730518746880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836543.339409:0:17170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81446a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:334968c0-1019-487d-94b4-b0d9e3b864ad+24:3618:x1875730518746880:12345-0@lo:400:kworker.0 Request processed in 214us (1857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836543.339415:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00080000:0.0:1788836543.339444:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788836543.339447:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788836543.339450:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788836543.339504:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a81412eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:334968c0-1019-487d-94b4-b0d9e3b864ad:3618:1875730518746880:0@lo:400:kworker.0 00000100:00100000:3.0:1788836543.340528:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a81412e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1875730518748160:0@lo:400:kworker.0 00000100:00100000:3.0:1788836543.340552:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a81412e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875730518747264:0@lo:400:kworker.0 00000100:00100000:3.0:1788836543.340564:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a81412e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1875730518747776:0@lo:400:kworker.0 00010000:00010000:2.0:1788836543.909660:0:17165:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836544.357775:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f535180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875730518748288:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788836544.357860:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836544.361268:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518748288 00000100:00100000:0.0:1788836544.361284:0:18698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518748288 00000100:00100000:0.0:1788836544.361364:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788836544.361375:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81412e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875730518748288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788836544.361410:0:18698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788836544.361530:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81412e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875730518748288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 157us (3670us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836544.361538:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788836544.361777:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f535180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875730518748288:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788836544.869740:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788836544.869767:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f536300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875730518748416:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788836544.869847:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836544.870009:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518748416 00000100:00100000:1.0:1788836544.870019:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518748416 00000100:00100000:1.0:1788836544.870073:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788836544.870083:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81412e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875730518748416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788836544.870129:0:17182:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788836544.870187:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81412e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875730518748416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836544.870195:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788836544.870415:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f536300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875730518748416:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788836544.871067:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788836544.871080:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8166d89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875730518748544:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788836544.871186:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836544.871339:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518748544 00000100:00100000:1.0:1788836544.871345:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518748544 00000100:00100000:1.0:1788836544.871385:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788836544.871393:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a816bd77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875730518748544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788836544.871584:0:17182:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1788836544.871706:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a816bd77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875730518748544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 312us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836544.871713:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788836544.871826:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8166d89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875730518748544:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788836544.933739:0:19379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788836545.007376:0:17943:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788836545.382335:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875730518748672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788836545.382411:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836545.382563:0:20219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518748672 00000100:00100000:0.0:1788836545.382571:0:20219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518748672 00000100:00100000:0.0:1788836545.382640:0:20219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788836545.382651:0:20219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166d88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875730518748672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788836545.382676:0:20219:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788836545.382722:0:20219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166d88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875730518748672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836545.382729:0:20219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1788836545.382883:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788836545.382923:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875730518748672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788836545.500868:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:0.0:1788836545.501354:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511316864 00000100:00100000:0.0:1788836545.501365:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511316864 00000100:00100000:0.0:1788836545.501447:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 13 00000100:00100000:0.0:1788836545.501544:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166d8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee0d308b-6c11-4335-8f83-16d974416bdb+13:16405:x1875730511316864:12345-192.168.201.44@tcp:35:umount.0 00000001:00080000:0.0:1788836545.501801:0:17180:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:0.0:1788836545.501884:0:17180:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000100:00100000:0.0:1788836545.502001:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166d8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee0d308b-6c11-4335-8f83-16d974416bdb+16:16405:x1875730511316864:12345-192.168.201.44@tcp:35:umount.0 Request processed in 472us (1143us total) trans 8589934626 rc 0/0 00000100:00100000:0.0:1788836545.502009:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 13 00000020:00080000:0.0:1788836545.502014:0:17180:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00080000:1.0:1788836545.502457:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788836545.505945:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836545.506000:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:0.0:1788836545.506106:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511317120 00000100:00100000:0.0:1788836545.506115:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511317120 00000100:00100000:0.0:1788836545.506182:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511316992 00000100:00100000:0.0:1788836545.506185:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511316992 00000100:00100000:0.0:1788836545.506214:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 3 00000100:00100000:0.0:1788836545.506225:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81412e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c451bd85-d8bd-40d7-a376-2671340ce3ab+14:2409:x1875730511317120:12345-192.168.201.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836545.506241:0:17163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836545.506260:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8167974600/0xbd163c7375715c21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e310 expref: 14 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836545.506291:0:17163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836545.506343:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81412e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c451bd85-d8bd-40d7-a376-2671340ce3ab+13:2409:x1875730511317120:12345-192.168.201.44@tcp:103:ldlm_bl.0 Request processed in 119us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836545.506350:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 3 00000100:00100000:0.0:1788836545.506367:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 4 00000100:00100000:0.0:1788836545.506374:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8041422c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c451bd85-d8bd-40d7-a376-2671340ce3ab+12:2409:x1875730511316992:12345-192.168.201.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836545.506382:0:17163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836545.506393:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8141497c00/0xbd163c7375715c1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e2df expref: 12 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836545.506412:0:17163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836545.506431:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8041422c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c451bd85-d8bd-40d7-a376-2671340ce3ab+11:2409:x1875730511316992:12345-192.168.201.44@tcp:103:ldlm_bl.0 Request processed in 57us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836545.506437:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 4 00000100:00100000:3.0:1788836545.522202:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:0.0:1788836545.522355:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511317248 00000100:00100000:0.0:1788836545.522365:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511317248 00000100:00100000:0.0:1788836545.522428:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 5 00000100:00100000:0.0:1788836545.522438:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81412e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c451bd85-d8bd-40d7-a376-2671340ce3ab+11:2410:x1875730511317248:12345-192.168.201.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836545.522511:0:17163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836545.522531:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8141497800/0xbd163c7375715cde lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e3c6 expref: 11 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836545.522551:0:17163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836545.522607:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81412e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c451bd85-d8bd-40d7-a376-2671340ce3ab+10:2410:x1875730511317248:12345-192.168.201.44@tcp:103:ldlm_bl.0 Request processed in 170us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836545.522640:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 5 00000100:00100000:1.0:1788836545.527153:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836545.527296:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511317376 00000100:00100000:3.0:1788836545.527307:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511317376 00000100:00100000:3.0:1788836545.527408:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 34 00000100:00100000:3.0:1788836545.527420:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166d89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee0d308b-6c11-4335-8f83-16d974416bdb+5:2407:x1875730511317376:12345-192.168.201.44@tcp:9:umount.0 00000020:00000080:3.0:1788836545.527510:0:18696:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c7375715c3d 00000100:00080000:3.0:1788836545.527520:0:18696:0:(import.c:65:import_set_state_nolock()) ffff9a8046317800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788836545.527595:0:18696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1788836545.527761:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166d89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee0d308b-6c11-4335-8f83-16d974416bdb+2:2407:x1875730511317376:12345-192.168.201.44@tcp:9:umount.0 Request processed in 343us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836545.527769:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 34 00010000:00010000:2.0:1788836545.528023:0:19380:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788836545.528293:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788836545.545980:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836545.546512:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511318272 00000100:00100000:1.0:1788836545.546524:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511318272 00000100:00100000:1.0:1788836545.546619:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 67 00000100:00100000:1.0:1788836545.546630:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81412eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee0d308b-6c11-4335-8f83-16d974416bdb+16:2407:x1875730511318272:12345-192.168.201.44@tcp:39:umount.0 00000020:00000080:1.0:1788836545.546673:0:17179:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c7375715c2f 00000020:00010000:1.0:1788836545.546694:0:17179:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9a8045637000: total 0 00000100:00080000:1.0:1788836545.546699:0:17179:0:(import.c:65:import_set_state_nolock()) ffff9a8045630000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788836545.546733:0:17179:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:1.0:1788836545.546933:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81412eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee0d308b-6c11-4335-8f83-16d974416bdb+15:2407:x1875730511318272:12345-192.168.201.44@tcp:39:umount.0 Request processed in 305us (991us total) trans 8589934627 rc 0/0 00000100:00100000:1.0:1788836545.546942:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 67 00000020:00010000:2.0:1788836545.547410:0:17166:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9a8045637000: total 0 00010000:00010000:2.0:1788836545.547516:0:17166:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a8045637000, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1788836545.547561:0:17166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a8047355500) 00010000:00010000:2.0:1788836545.547565:0:17166:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788836545.547573:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8167975000/0xbd163c7375715e58 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e436 expref: 14 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836545.547592:0:17166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a8047355500) 00010000:00010000:2.0:1788836545.547595:0:17166:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788836545.547599:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8141496400/0xbd163c7375715f38 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e483 expref: 13 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836545.547624:0:17166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8047355a00) 00010000:00010000:2.0:1788836545.547627:0:17166:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836545.547631:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a814659c800/0xbd163c7375715d16 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e3d4 expref: 12 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836545.547656:0:17166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8047365300) 00010000:00010000:2.0:1788836545.547659:0:17166:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788836545.547663:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8167975800/0xbd163c7375715d55 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e3e2 expref: 11 pid: 19980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836545.547676:0:17166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a8164675500) 00010000:00010000:2.0:1788836545.547693:0:17166:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788836545.547698:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8141496800/0xbd163c7375715ee4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e460 expref: 10 pid: 19980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836545.547717:0:17166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a8047365e00) 00010000:00010000:2.0:1788836545.547719:0:17166:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788836545.547723:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8167974e00/0xbd163c7375715cfa lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e3cd expref: 9 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836545.547740:0:17166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a8148e5a800) 00010000:00010000:2.0:1788836545.547742:0:17166:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788836545.547746:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8141496200/0xbd163c7375715dda lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e40c expref: 8 pid: 19980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836545.547762:0:17166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a8047355500) 00010000:00010000:2.0:1788836545.547764:0:17166:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788836545.547769:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a804738de00/0xbd163c7375715e89 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e44b expref: 7 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836545.547782:0:17166:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a8045637000, canceled 8 locks, left on hash table 0. 00010000:00010000:2.0:1788836545.547797:0:17166:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836545.547799:0:17166:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836545.547802:0:17166:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836545.587349:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836545.587532:0:19980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511318400 00000100:00100000:1.0:1788836545.587551:0:19980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511318400 00000100:00080000:0.0:1788836545.587708:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788836545.587817:0:19980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 68 00000100:00100000:1.0:1788836545.587832:0:19980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81412e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee0d308b-6c11-4335-8f83-16d974416bdb+5:2407:x1875730511318400:12345-192.168.201.44@tcp:39:umount.0 00000020:00000080:1.0:1788836545.587883:0:19980:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c7375715c36 00000100:00080000:1.0:1788836545.587903:0:19980:0:(import.c:65:import_set_state_nolock()) ffff9a8046310000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788836545.587936:0:19980:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:2.0:1788836545.588374:0:17165:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836545.588708:0:19980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81412e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee0d308b-6c11-4335-8f83-16d974416bdb+3:2407:x1875730511318400:12345-192.168.201.44@tcp:39:umount.0 Request processed in 879us (1373us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788836545.588718:0:19980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 68 00010000:00010000:1.0:1788836545.958112:0:19379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836546.417309:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:0.0:1788836546.417354:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:0.0:1788836546.417391:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836546.417707:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511318784 00000100:00100000:2.0:1788836546.417717:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511318784 00000100:00100000:2.0:1788836546.417793:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511318656 00000100:00100000:2.0:1788836546.417796:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511318656 00000100:00100000:2.0:1788836546.417819:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 113 00000100:00100000:2.0:1788836546.417828:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a816bd74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb7aabf5-9d6a-41ab-bbbe-35969986acd6+5:2411:x1875730511318784:12345-192.168.201.44@tcp:400:kworker.0 00000100:00100000:2.0:1788836546.417916:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a816bd74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb7aabf5-9d6a-41ab-bbbe-35969986acd6+5:2411:x1875730511318784:12345-192.168.201.44@tcp:400:kworker.0 Request processed in 89us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836546.417924:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 113 00000100:00100000:2.0:1788836546.417943:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 114 00000100:00100000:2.0:1788836546.417949:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a816bd74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb7aabf5-9d6a-41ab-bbbe-35969986acd6+6:2411:x1875730511318656:12345-192.168.201.44@tcp:400:kworker.0 00000100:00100000:2.0:1788836546.417986:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a816bd74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb7aabf5-9d6a-41ab-bbbe-35969986acd6+6:2411:x1875730511318656:12345-192.168.201.44@tcp:400:kworker.0 Request processed in 37us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836546.417993:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 114 00000100:00100000:1.0:1788836546.418236:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511318528 00000100:00100000:1.0:1788836546.418241:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511318528 00000100:00100000:1.0:1788836546.418282:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 177 00000100:00100000:1.0:1788836546.418289:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f465c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c451bd85-d8bd-40d7-a376-2671340ce3ab+10:2411:x1875730511318528:12345-192.168.201.44@tcp:400:kworker.0 00000100:00100000:1.0:1788836546.418322:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f465c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c451bd85-d8bd-40d7-a376-2671340ce3ab+10:2411:x1875730511318528:12345-192.168.201.44@tcp:400:kworker.0 Request processed in 34us (1024us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836546.418329:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 177 00000100:00080000:0.0:1788836546.418730:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788836546.418735:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788836546.981886:0:19380:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836547.445006:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:0.0:1788836547.445079:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836547.445162:0:20220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511318912 00000100:00100000:2.0:1788836547.445176:0:20220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511318912 00000100:00100000:2.0:1788836547.445253:0:20220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511319040 00000100:00100000:2.0:1788836547.445256:0:20220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511319040 00000100:00100000:2.0:1788836547.445295:0:20220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 6 00000100:00100000:2.0:1788836547.445307:0:20220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a816bd75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c451bd85-d8bd-40d7-a376-2671340ce3ab+11:2410:x1875730511318912:12345-192.168.201.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836547.445328:0:20220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836547.445355:0:20220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a814659cc00/0xbd163c7375715c59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e34f expref: 11 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836547.445377:0:20220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836547.445519:0:20220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a816bd75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c451bd85-d8bd-40d7-a376-2671340ce3ab+10:2410:x1875730511318912:12345-192.168.201.44@tcp:103:ldlm_bl.0 Request processed in 214us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836547.445528:0:20220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 6 00000100:00100000:2.0:1788836547.445548:0:20220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 7 00000100:00100000:2.0:1788836547.445555:0:20220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a816bd76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c451bd85-d8bd-40d7-a376-2671340ce3ab+9:2410:x1875730511319040:12345-192.168.201.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836547.445580:0:20220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836547.445590:0:20220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a814659c600/0xbd163c7375715c60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e380 expref: 9 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836547.445599:0:20220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836547.445616:0:20220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a816bd76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c451bd85-d8bd-40d7-a376-2671340ce3ab+8:2410:x1875730511319040:12345-192.168.201.44@tcp:103:ldlm_bl.0 Request processed in 63us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836547.445622:0:20220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 7 00000100:00100000:1.0:1788836547.447208:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836547.447288:0:20220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511319168 00000100:00100000:2.0:1788836547.447298:0:20220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511319168 00000100:00100000:2.0:1788836547.447359:0:20220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 8 00000100:00100000:2.0:1788836547.447369:0:20220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166d8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c451bd85-d8bd-40d7-a376-2671340ce3ab+8:2410:x1875730511319168:12345-192.168.201.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836547.447383:0:20220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836547.447401:0:20220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a804738d400/0xbd163c7375715cd7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e3bf expref: 8 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836547.447428:0:20220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836547.447513:0:20220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166d8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c451bd85-d8bd-40d7-a376-2671340ce3ab+7:2410:x1875730511319168:12345-192.168.201.44@tcp:103:ldlm_bl.0 Request processed in 145us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836547.447521:0:20220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 8 00000100:00100000:2.0:1788836547.461653:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836547.461874:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511319424 00000100:00100000:3.0:1788836547.461887:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511319424 00000100:00100000:3.0:1788836547.461957:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 69 00000100:00100000:3.0:1788836547.461968:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f537b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb7aabf5-9d6a-41ab-bbbe-35969986acd6+6:2407:x1875730511319424:12345-192.168.201.44@tcp:39:umount.0 00000020:00000080:3.0:1788836547.462022:0:17176:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c7375715c6e 00000020:00010000:3.0:1788836547.462036:0:17176:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9a8166da3800: total 0 00000100:00080000:3.0:1788836547.462041:0:17176:0:(import.c:65:import_set_state_nolock()) ffff9a8166da1800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788836547.462081:0:17176:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00100000:3.0:1788836547.462270:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f537b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb7aabf5-9d6a-41ab-bbbe-35969986acd6+5:2407:x1875730511319424:12345-192.168.201.44@tcp:39:umount.0 Request processed in 304us (633us total) trans 8589934628 rc 0/0 00000100:00100000:3.0:1788836547.462278:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 69 00000020:00010000:0.0:1788836547.462734:0:17166:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9a8166da3800: total 0 00010000:00010000:0.0:1788836547.462748:0:17166:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836547.462815:0:17166:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a8166da3800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788836547.462856:0:17166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8047365300) 00010000:00010000:0.0:1788836547.462860:0:17166:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788836547.462869:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8167975c00/0xbd163c7375715d63 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e3e9 expref: 4 pid: 17176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836547.462894:0:17166:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a8166da3800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788836547.462903:0:17166:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836547.462905:0:17166:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836547.462906:0:17166:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836547.476962:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836547.477771:0:19980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511319552 00000100:00100000:1.0:1788836547.477789:0:19980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511319552 00000100:00100000:1.0:1788836547.477887:0:19980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 70 00000100:00100000:1.0:1788836547.477900:0:19980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a816bd77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb7aabf5-9d6a-41ab-bbbe-35969986acd6+5:2407:x1875730511319552:12345-192.168.201.44@tcp:39:umount.0 00000020:00000080:1.0:1788836547.477965:0:19980:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c7375715c75 00000100:00080000:1.0:1788836547.477982:0:19980:0:(import.c:65:import_set_state_nolock()) ffff9a8166da0800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788836547.478024:0:19980:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:1.0:1788836547.478261:0:19980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a816bd77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb7aabf5-9d6a-41ab-bbbe-35969986acd6+3:2407:x1875730511319552:12345-192.168.201.44@tcp:39:umount.0 Request processed in 362us (1314us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788836547.478270:0:19980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 70 00010000:00010000:2.0:1788836547.478597:0:17165:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836547.503654:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836547.503978:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511319808 00000100:00100000:3.0:1788836547.504001:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511319808 00000100:00100000:3.0:1788836547.504077:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 178 00000100:00100000:3.0:1788836547.504090:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f467c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c451bd85-d8bd-40d7-a376-2671340ce3ab+7:2407:x1875730511319808:12345-192.168.201.44@tcp:251:umount.0 00000020:00000080:3.0:1788836547.504153:0:17172:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c7375715c0c 00000020:00010000:3.0:1788836547.504163:0:17172:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9a8046220000: total 0 00000100:00080000:3.0:1788836547.504169:0:17172:0:(import.c:65:import_set_state_nolock()) ffff9a81646c1800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788836547.504257:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f467c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c451bd85-d8bd-40d7-a376-2671340ce3ab+3:2407:x1875730511319808:12345-192.168.201.44@tcp:251:umount.0 Request processed in 169us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836547.504266:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 178 00000020:00010000:0.0:1788836547.506582:0:19379:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9a8046220000: total 0 00010000:00010000:0.0:1788836547.506683:0:19379:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a8046220000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788836547.506733:0:19379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a804738ce00/0xbd163c7375715c13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e2d8 expref: 2 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836547.506756:0:19379:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a8046220000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1788836547.507084:0:19379:0:(genops.c:885:class_export_put()) final put ffff9a8046220000/c451bd85-d8bd-40d7-a376-2671340ce3ab 00010000:00010000:0.0:1788836547.507119:0:19379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836547.507122:0:19379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836547.507124:0:19379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788836547.507200:0:16590:0:(genops.c:844:class_export_destroy()) destroying export ffff9a8046220000/c451bd85-d8bd-40d7-a376-2671340ce3ab for MGS 00000020:00000080:2.0:1788836547.507252:0:16590:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a81646c1800 for MGS 00010000:00010000:2.0:1788836548.005803:0:19380:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836548.455707:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8167b33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875730518748800:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788836548.455781:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836548.455985:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788836548.455999:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f536a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875730518748928:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788836548.456040:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836548.456110:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518748800 00000100:00100000:1.0:1788836548.456118:0:18699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518748800 00000100:00100000:1.0:1788836548.456180:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518748928 00000100:00100000:1.0:1788836548.456183:0:18699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518748928 00000100:00100000:1.0:1788836548.456200:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788836548.456208:0:18699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8167b31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875730518748800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788836548.456238:0:18699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788836548.456279:0:18699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8167b31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875730518748800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836548.456287:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788836548.456302:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788836548.456307:0:18699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f536300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875730518748928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788836548.456316:0:18699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788836548.456346:0:18699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f536300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875730518748928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 38us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836548.456352:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788836548.456391:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f536a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875730518748928:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788836548.456433:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8167b33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875730518748800:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788836548.456567:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788836548.456915:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788836548.457969:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875730518749184:0@lo:400:kworker.0 00000100:00100000:1.0:1788836548.458025:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836548.458067:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788836548.458074:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875730518749312:0@lo:400:kworker.0 00000100:00100000:1.0:1788836548.458098:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836548.458135:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518749184 00000100:00100000:1.0:1788836548.458140:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518749184 00000100:00100000:1.0:1788836548.458180:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788836548.458187:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8167b33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875730518749184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836548.458231:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8167b33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875730518749184:12345-0@lo:400:kworker.0 Request processed in 45us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836548.458237:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788836548.458257:0:18697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518749312 00000100:00100000:1.0:1788836548.458260:0:18697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518749312 00000100:00100000:1.0:1788836548.458292:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788836548.458299:0:18697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8167b30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875730518749312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836548.458327:0:18697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8167b30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875730518749312:12345-0@lo:400:kworker.0 Request processed in 30us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836548.458333:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1788836548.458355:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788836548.458362:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788836548.458370:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875730518749440:0@lo:400:kworker.0 00000100:00100000:1.0:1788836548.458395:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836548.458433:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518749440 00000100:00100000:1.0:1788836548.458437:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518749440 00000100:00100000:1.0:1788836548.458481:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788836548.458487:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8167b30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875730518749440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836548.458521:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8167b30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875730518749440:12345-0@lo:400:kworker.0 Request processed in 34us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836548.458527:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788836548.458567:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875730518749312:0@lo:400:kworker.0 00000100:00100000:1.0:1788836548.458576:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875730518749184:0@lo:400:kworker.0 00000100:00100000:1.0:1788836548.458632:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875730518749440:0@lo:400:kworker.0 00000100:00100000:2.0:1788836548.464981:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:334968c0-1019-487d-94b4-b0d9e3b864ad:3618:1875730518749056:0@lo:400:kworker.0 00000100:00100000:2.0:1788836548.465064:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836548.465733:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875730518749824:0@lo:400:kworker.0 00000100:00100000:1.0:1788836548.465780:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836548.465805:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1875730518750336:0@lo:400:kworker.0 00000100:00100000:1.0:1788836548.465825:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836548.465856:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788836548.465861:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875730518749696:0@lo:400:kworker.0 00000100:00100000:1.0:1788836548.465883:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836548.465900:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1875730518750208:0@lo:400:kworker.0 00000100:00100000:1.0:1788836548.465919:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836548.465947:0:19980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518749824 00000100:00100000:1.0:1788836548.465955:0:19980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518749824 00000100:00100000:1.0:1788836548.465996:0:19980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518750336 00000100:00100000:1.0:1788836548.465999:0:19980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518750336 00000100:00100000:1.0:1788836548.466021:0:19980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518750208 00000100:00100000:1.0:1788836548.466024:0:19980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518750208 00000100:00100000:1.0:1788836548.466038:0:19980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788836548.466045:0:19980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8167b31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875730518749824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836548.466097:0:19980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8167b31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875730518749824:12345-0@lo:400:kworker.0 Request processed in 51us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836548.466103:0:19980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788836548.466120:0:19980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788836548.466126:0:19980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8167b32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875730518750336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836548.466152:0:19980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8167b32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875730518750336:12345-0@lo:400:kworker.0 Request processed in 26us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836548.466158:0:19980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788836548.466179:0:19980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788836548.466185:0:19980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8167b32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875730518750208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836548.466213:0:19980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8167b32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875730518750208:12345-0@lo:400:kworker.0 Request processed in 29us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836548.466218:0:19980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788836548.466240:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518749696 00000100:00100000:1.0:1788836548.466244:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518749696 00000100:00100000:1.0:1788836548.466274:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788836548.466281:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8167b33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875730518749696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836548.466310:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8167b33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875730518749696:12345-0@lo:400:kworker.0 Request processed in 30us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836548.466316:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1788836548.466338:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788836548.466343:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788836548.466345:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788836548.466357:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875730518749568:0@lo:400:kworker.0 00000100:00100000:1.0:1788836548.466384:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836548.466415:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875730518750080:0@lo:400:kworker.0 00000100:00100000:1.0:1788836548.466436:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836548.466452:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788836548.466458:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875730518749952:0@lo:400:kworker.0 00000100:00100000:1.0:1788836548.466500:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836548.466522:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518750080 00000100:00100000:1.0:1788836548.466526:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518750080 00000100:00100000:1.0:1788836548.466550:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518749952 00000100:00100000:1.0:1788836548.466554:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518749952 00000100:00100000:1.0:1788836548.466570:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788836548.466575:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8167b30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875730518750080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836548.466628:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8167b30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875730518750080:12345-0@lo:400:kworker.0 Request processed in 52us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836548.466633:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788836548.466645:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788836548.466650:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8167b30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875730518749952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836548.466673:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8167b30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875730518749952:12345-0@lo:400:kworker.0 Request processed in 23us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836548.466678:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:1.0:1788836548.466692:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788836548.466694:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788836548.466704:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518749568 00000100:00100000:1.0:1788836548.466707:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518749568 00000100:00100000:1.0:1788836548.466729:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788836548.466736:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8167b31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875730518749568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836548.466766:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8167b31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875730518749568:12345-0@lo:400:kworker.0 Request processed in 30us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836548.466772:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788836548.466814:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875730518749952:0@lo:400:kworker.0 00000100:00100000:1.0:1788836548.466824:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875730518749568:0@lo:400:kworker.0 00010000:00080000:1.0:1788836548.466834:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a816bd74a80 x1875730518750080/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836548.466844:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875730518750080:0@lo:400:kworker.0 00000100:00100000:1.0:1788836548.466875:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875730518749696:0@lo:400:kworker.0 00000100:00100000:1.0:1788836548.466884:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1875730518750208:0@lo:400:kworker.0 00000100:00100000:1.0:1788836548.466902:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875730518749824:0@lo:400:kworker.0 00010000:00080000:1.0:1788836548.466911:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a816bd74700 x1875730518750336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836548.466920:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1875730518750336:0@lo:400:kworker.0 00000100:00100000:3.0:1788836548.467567:0:17170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518749056 00000100:00100000:3.0:1788836548.467574:0:17170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518749056 00000100:00100000:3.0:1788836548.467743:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788836548.467753:0:17170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:334968c0-1019-487d-94b4-b0d9e3b864ad+24:3618:x1875730518749056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836548.467823:0:17170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:334968c0-1019-487d-94b4-b0d9e3b864ad+24:3618:x1875730518749056:12345-0@lo:400:kworker.0 Request processed in 71us (2758us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836548.467829:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788836548.467939:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:334968c0-1019-487d-94b4-b0d9e3b864ad:3618:1875730518749056:0@lo:400:kworker.0 00010000:00010000:3.0:1788836549.031958:0:17166:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836549.482163:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f535180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875730518750464:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788836549.482234:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836549.482310:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518750464 00000100:00100000:2.0:1788836549.482317:0:18699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518750464 00000100:00100000:2.0:1788836549.482362:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788836549.482371:0:18699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f534380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875730518750464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788836549.482414:0:18699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788836549.482476:0:18699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f534380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875730518750464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836549.482483:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788836549.482528:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f535180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875730518750464:0@lo:13:osp-pre-0-1.0 00000020:01000004:0.0:1788836549.629370:0:20765:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788836549.647742:0:20765:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788836549.647816:0:20765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a817f41aa00/0xbd163c73757157cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c73757157d6 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836549.647832:0:20765:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a817f41aa00/0xbd163c73757157cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd163c73757157d6 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836549.647840:0:20765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a817f41aa00/0xbd163c73757157cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd163c73757157d6 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836549.647848:0:20765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.144@tcp lock: ffff9a817f41aa00/0xbd163c73757157cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd163c73757157d6 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836549.647873:0:20765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788836549.647878:0:20765:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788836549.647899:0:20765:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788836549.647903:0:20765:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788836549.647908:0:20765:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788836549.647928:0:20765:0:(import.c:65:import_set_state_nolock()) ffff9a8179e94000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788836549.647972:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875730518750592:0@lo:39:umount.0 00000100:00100000:1.0:1788836549.648026:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836549.648122:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518750592 00000100:00100000:3.0:1788836549.648130:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518750592 00000100:00100000:3.0:1788836549.648183:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788836549.648192:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8167b33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875730518750592:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788836549.648218:0:17179:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c7375715800 00000100:00080000:3.0:1788836549.648226:0:17179:0:(import.c:65:import_set_state_nolock()) ffff9a80414bb800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788836549.648331:0:17165:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836549.648338:0:17165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.144@tcp lock: ffff9a817f41aa00/0xbd163c73757157cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd163c73757157d6 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836549.648346:0:17165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a817f41aa00 already unused, calling callback (ffffffffc139ec20) 10000000:00010000:2.0:1788836549.648350:0:17165:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.144@tcp lock: ffff9a817f41aa00/0xbd163c73757157cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd163c73757157d6 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836549.648360:0:17165:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.144@tcp lock: ffff9a817f41aa00/0xbd163c73757157cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xbd163c73757157d6 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788836549.648375:0:17165:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.144@tcp lock: ffff9a817f41aa00/0xbd163c73757157cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xbd163c73757157d6 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836549.648390:0:17165:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788836549.648393:0:17165:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788836549.648395:0:17165:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788836549.648420:0:17165:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.144@tcp lock: ffff9a817f41aa00/0xbd163c73757157cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd163c73757157d6 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836549.648425:0:17165:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788836549.648445:0:17165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.144@tcp lock: ffff9a817f41aa00/0xbd163c73757157cf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd163c73757157d6 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836549.648451:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.144@tcp lock: ffff9a817f41aa00/0xbd163c73757157cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd163c73757157d6 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836549.648478:0:17165:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836549.648480:0:17165:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836549.648481:0:17165:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836549.648486:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788836549.648494:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f535180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:334968c0-1019-487d-94b4-b0d9e3b864ad:3618:1875730518750720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788836549.648517:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836549.648545:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518750720 00000100:00100000:2.0:1788836549.648547:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518750720 00000100:00100000:2.0:1788836549.648581:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788836549.648585:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f534700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:334968c0-1019-487d-94b4-b0d9e3b864ad+24:3618:x1875730518750720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788836549.648594:0:17163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836549.648604:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a80462e7400/0xbd163c73757157d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbd163c73757157cf expref: 24 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836549.648619:0:17163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836549.648639:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f534700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:334968c0-1019-487d-94b4-b0d9e3b864ad+23:3618:x1875730518750720:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836549.648644:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788836549.648669:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f535180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:334968c0-1019-487d-94b4-b0d9e3b864ad:3618:1875730518750720:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788836549.651306:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8167b33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3617:x1875730518750592:12345-0@lo:39:umount.0 Request processed in 3104us (3266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836549.651320:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:3.0:1788836549.651335:0:17179:0:(genops.c:885:class_export_put()) final put ffff9a80414b9000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:1.0:1788836549.651351:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9a8179e94000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788836549.651364:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875730518750592:0@lo:39:umount.0 00010000:00010000:3.0:1788836549.651374:0:19379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788836549.651418:0:20765:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788836549.651423:0:20765:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788836549.651427:0:20765:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788836549.652253:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a80414b9000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788836549.652340:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a80414bb800 for lustre-MDT0000 00010000:00010000:2.0:1788836549.653908:0:20765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a817f41a200/0xbd163c7375715720 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375715727 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836549.653925:0:20765:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a817f41a200/0xbd163c7375715720 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd163c7375715727 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836549.653933:0:20765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a817f41a200/0xbd163c7375715720 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd163c7375715727 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836549.653939:0:20765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.144@tcp lock: ffff9a817f41a200/0xbd163c7375715720 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd163c7375715727 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836549.653955:0:20765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788836549.653960:0:20765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a817f41a000/0xbd163c7375715b2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375715b33 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836549.653966:0:20765:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a817f41a000/0xbd163c7375715b2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd163c7375715b33 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836549.653972:0:20765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a817f41a000/0xbd163c7375715b2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd163c7375715b33 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836549.653988:0:20765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.144@tcp lock: ffff9a817f41a000/0xbd163c7375715b2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd163c7375715b33 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836549.654035:0:20765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788836549.654043:0:20765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a8167975e00/0xbd163c7375715cc9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375715cd0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836549.654050:0:20765:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a8167975e00/0xbd163c7375715cc9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd163c7375715cd0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836549.654056:0:20765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a8167975e00/0xbd163c7375715cc9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd163c7375715cd0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836549.654062:0:20765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.144@tcp lock: ffff9a8167975e00/0xbd163c7375715cc9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd163c7375715cd0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836549.654114:0:17166:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788836549.654122:0:17166:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.144@tcp lock: ffff9a817f41a200/0xbd163c7375715720 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd163c7375715727 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836549.654129:0:17166:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a817f41a200 already unused, calling callback (ffffffffc139ec20) 10000000:00010000:0.0:1788836549.654132:0:17166:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.144@tcp lock: ffff9a817f41a200/0xbd163c7375715720 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd163c7375715727 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836549.654147:0:17166:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.144@tcp lock: ffff9a817f41a200/0xbd163c7375715720 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xbd163c7375715727 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788836549.654154:0:17166:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.144@tcp lock: ffff9a817f41a200/0xbd163c7375715720 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xbd163c7375715727 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836549.654160:0:17166:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788836549.654163:0:17166:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1788836549.654193:0:17166:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.144@tcp lock: ffff9a817f41a200/0xbd163c7375715720 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd163c7375715727 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836549.654198:0:17166:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788836549.654221:0:17166:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.144@tcp lock: ffff9a817f41a200/0xbd163c7375715720 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd163c7375715727 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836549.654228:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.144@tcp lock: ffff9a817f41a200/0xbd163c7375715720 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd163c7375715727 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836549.654241:0:17166:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788836549.654244:0:17166:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.144@tcp lock: ffff9a817f41a000/0xbd163c7375715b2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd163c7375715b33 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836549.654249:0:17166:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a817f41a000 already unused, calling callback (ffffffffc139ec20) 10000000:00010000:0.0:1788836549.654252:0:17166:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.144@tcp lock: ffff9a817f41a000/0xbd163c7375715b2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd163c7375715b33 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836549.654258:0:17166:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.144@tcp lock: ffff9a817f41a000/0xbd163c7375715b2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xbd163c7375715b33 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788836549.654264:0:17166:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.144@tcp lock: ffff9a817f41a000/0xbd163c7375715b2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xbd163c7375715b33 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836549.654275:0:17166:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788836549.654277:0:17166:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788836549.654279:0:17166:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788836549.654294:0:17166:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.144@tcp lock: ffff9a817f41a000/0xbd163c7375715b2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd163c7375715b33 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836549.654300:0:17166:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788836549.654305:0:17166:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.144@tcp lock: ffff9a817f41a000/0xbd163c7375715b2c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd163c7375715b33 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836549.654312:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.144@tcp lock: ffff9a817f41a000/0xbd163c7375715b2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd163c7375715b33 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836549.654321:0:17166:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836549.654324:0:17166:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.144@tcp lock: ffff9a8167975e00/0xbd163c7375715cc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd163c7375715cd0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836549.654329:0:17166:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8167975e00 already unused, calling callback (ffffffffc139ec20) 10000000:00010000:0.0:1788836549.654332:0:17166:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.144@tcp lock: ffff9a8167975e00/0xbd163c7375715cc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd163c7375715cd0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836549.654337:0:17166:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.144@tcp lock: ffff9a8167975e00/0xbd163c7375715cc9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xbd163c7375715cd0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788836549.654343:0:17166:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.144@tcp lock: ffff9a8167975e00/0xbd163c7375715cc9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xbd163c7375715cd0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836549.654348:0:17166:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788836549.654350:0:17166:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1788836549.654367:0:17166:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.144@tcp lock: ffff9a8167975e00/0xbd163c7375715cc9 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd163c7375715cd0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836549.654373:0:17166:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788836549.654412:0:17166:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.144@tcp lock: ffff9a8167975e00/0xbd163c7375715cc9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd163c7375715cd0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836549.654420:0:17166:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836549.654421:0:17166:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836549.654423:0:17166:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836549.654440:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:334968c0-1019-487d-94b4-b0d9e3b864ad:3620:1875730518750848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788836549.654533:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836549.654649:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:334968c0-1019-487d-94b4-b0d9e3b864ad:3618:1875730518751104:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788836549.654680:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836549.654731:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518750848 00000100:00100000:1.0:1788836549.654738:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518750848 00000100:00100000:1.0:1788836549.654780:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518751104 00000100:00100000:1.0:1788836549.654783:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518751104 00000100:00100000:1.0:1788836549.654805:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788836549.654813:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a816bd75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:334968c0-1019-487d-94b4-b0d9e3b864ad+24:3620:x1875730518750848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788836549.654824:0:17162:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836549.654837:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a815158f000/0xbd163c7375715727 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbd163c7375715720 expref: 24 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836549.654848:0:17162:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836549.654874:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a816bd75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:334968c0-1019-487d-94b4-b0d9e3b864ad+23:3620:x1875730518750848:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836549.654881:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788836549.654895:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788836549.654907:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8041420450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:334968c0-1019-487d-94b4-b0d9e3b864ad+22:3618:x1875730518751104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788836549.654913:0:17162:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836549.654922:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a804738d800/0xbd163c7375715cd0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbd163c7375715cc9 expref: 22 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836549.654930:0:17162:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836549.654953:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8041420450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:334968c0-1019-487d-94b4-b0d9e3b864ad+21:3618:x1875730518751104:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836549.654958:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788836549.655015:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:334968c0-1019-487d-94b4-b0d9e3b864ad:3618:1875730518751104:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788836549.655069:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:334968c0-1019-487d-94b4-b0d9e3b864ad:3620:1875730518750848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788836549.655080:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788836549.655085:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:334968c0-1019-487d-94b4-b0d9e3b864ad:3620:1875730518750976:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788836549.655105:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836549.655138:0:20220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518750976 00000100:00100000:0.0:1788836549.655142:0:20220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518750976 00000100:00100000:0.0:1788836549.655166:0:20220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788836549.655172:0:20220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a816bd75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:334968c0-1019-487d-94b4-b0d9e3b864ad+21:3620:x1875730518750976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788836549.655178:0:20220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836549.655187:0:20220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a814659d600/0xbd163c7375715b33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbd163c7375715b2c expref: 21 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836549.655196:0:20220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836549.655218:0:20220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a816bd75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:334968c0-1019-487d-94b4-b0d9e3b864ad+20:3620:x1875730518750976:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836549.655223:0:20220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788836549.655252:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:334968c0-1019-487d-94b4-b0d9e3b864ad:3620:1875730518750976:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788836549.655821:0:20765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788836549.655830:0:20765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.144@tcp lock: ffff9a8167975e00/0xbd163c7375715cc9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd163c7375715cd0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836549.655842:0:20765:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788836549.655856:0:17165:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836549.655867:0:20765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a817f41b400/0xbd163c7375715712 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375715719 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836549.655876:0:20765:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a817f41b400/0xbd163c7375715712 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd163c7375715719 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836549.655882:0:20765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a817f41b400/0xbd163c7375715712 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd163c7375715719 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836549.655896:0:20765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.144@tcp lock: ffff9a817f41b400/0xbd163c7375715712 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd163c7375715719 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836549.655911:0:20765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788836549.655915:0:20765:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1788836549.655918:0:20765:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1788836549.655947:0:20765:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788836549.655951:0:20765:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1788836549.655954:0:20765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788836549.655959:0:20765:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:2.0:1788836549.655964:0:20765:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9a80472e0800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788836549.655971:0:20765:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9a804612c800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788836549.655975:0:20765:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9a81646c1000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788836549.655980:0:20765:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9a8151462800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788836549.655987:0:20765:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9a8166da3800 eb7aabf5-9d6a-41ab-bbbe-35969986acd6 192.168.201.44@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:2.0:1788836549.655992:0:20765:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9a8045637000 ee0d308b-6c11-4335-8f83-16d974416bdb 192.168.201.44@tcp 5 (0 5 0) 1 0 0 0: 0000000000000000 8589934623 stale:0 00000020:00080000:2.0:1788836549.655996:0:20765:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9a817f4d8000) has exports, disconnecting them 00000020:00080000:2.0:1788836549.656000:0:20765:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a80472e0800), last request at 1788836548 00000020:00000080:2.0:1788836549.656006:0:20765:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c7375715afb 00000100:00080000:2.0:1788836549.656022:0:20765:0:(import.c:65:import_set_state_nolock()) ffff9a80472e0000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788836549.656068:0:20765:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a80472e0800): rc 0 00000020:00000080:2.0:1788836549.656071:0:20765:0:(genops.c:885:class_export_put()) final put ffff9a80472e0800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1788836549.656079:0:20765:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a804612c800), last request at 1788836548 00000020:00000080:2.0:1788836549.656082:0:20765:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c737571599d 00000100:00080000:2.0:1788836549.656087:0:20765:0:(import.c:65:import_set_state_nolock()) ffff9a804612d000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788836549.656106:0:17165:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836549.656111:0:17165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.144@tcp lock: ffff9a817f41b400/0xbd163c7375715712 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd163c7375715719 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836549.656119:0:17165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a817f41b400 already unused, calling callback (ffffffffc139ec20) 10000000:00010000:2.0:1788836549.656122:0:17165:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.144@tcp lock: ffff9a817f41b400/0xbd163c7375715712 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd163c7375715719 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836549.656130:0:17165:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.144@tcp lock: ffff9a817f41b400/0xbd163c7375715712 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xbd163c7375715719 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788836549.656137:0:17165:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.144@tcp lock: ffff9a817f41b400/0xbd163c7375715712 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xbd163c7375715719 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836549.656142:0:17165:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788836549.656144:0:17165:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788836549.656146:0:17165:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788836549.656168:0:17165:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.144@tcp lock: ffff9a817f41b400/0xbd163c7375715712 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd163c7375715719 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836549.656175:0:17165:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788836549.656189:0:17165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.144@tcp lock: ffff9a817f41b400/0xbd163c7375715712 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd163c7375715719 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836549.656195:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.144@tcp lock: ffff9a817f41b400/0xbd163c7375715712 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd163c7375715719 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836549.656204:0:17165:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836549.656205:0:17165:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836549.656207:0:17165:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788836549.656217:0:20765:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a804612c800): rc 0 00000020:00000080:2.0:1788836549.656224:0:20765:0:(genops.c:885:class_export_put()) final put ffff9a804612c800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1788836549.656230:0:20765:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a81646c1000), last request at 1788836462 00000020:00000080:2.0:1788836549.656233:0:20765:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c73757158ee 00000100:00080000:2.0:1788836549.656237:0:20765:0:(import.c:65:import_set_state_nolock()) ffff9a81646c4000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788836549.659289:0:17166:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836549.659318:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f535180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:334968c0-1019-487d-94b4-b0d9e3b864ad:3619:1875730518751232:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788836549.659403:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836549.659493:0:20220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518751232 00000100:00100000:0.0:1788836549.659501:0:20220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518751232 00000100:00100000:0.0:1788836549.659622:0:20220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788836549.659635:0:20220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a816bd76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:334968c0-1019-487d-94b4-b0d9e3b864ad+20:3619:x1875730518751232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788836549.659649:0:20220:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836549.659669:0:20220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a815158f200/0xbd163c7375715719 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbd163c7375715712 expref: 20 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836549.659686:0:20220:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836549.659725:0:20220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a816bd76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:334968c0-1019-487d-94b4-b0d9e3b864ad+19:3619:x1875730518751232:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836549.659733:0:20220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788836549.659770:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f535180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:334968c0-1019-487d-94b4-b0d9e3b864ad:3619:1875730518751232:0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1788836549.659856:0:16590:0:(genops.c:844:class_export_destroy()) destroying export ffff9a80472e0800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788836549.659913:0:16590:0:(genops.c:844:class_export_destroy()) destroying export ffff9a804612c800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788836549.659939:0:16590:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a80472e0000 for lustre-MDT0000 00000020:00000080:1.0:1788836549.659943:0:16590:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a804612d000 for lustre-MDT0000 00010000:00010000:2.0:1788836549.660040:0:17165:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788836549.660059:0:20765:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a81646c1000): rc 0 00000020:00000080:2.0:1788836549.660061:0:20765:0:(genops.c:885:class_export_put()) final put ffff9a81646c1000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1788836549.660076:0:20765:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a8151462800), last request at 1788836462 00000020:00000080:2.0:1788836549.660082:0:20765:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c7375715893 00000100:00080000:2.0:1788836549.660090:0:20765:0:(import.c:65:import_set_state_nolock()) ffff9a81646c7800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788836549.660110:0:20765:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000020:00080000:2.0:1788836549.660192:0:20765:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a8151462800): rc 0 00000004:00000080:2.0:1788836549.660198:0:20765:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffae36c82f3ae0 00000100:00080000:2.0:1788836549.660216:0:20765:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788836549.660219:0:20765:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:3.0:1788836549.660653:0:19380:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836549.660665:0:19379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836549.660739:0:17166:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788836549.661283:0:20765:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788836549.661305:0:20765:0:(import.c:65:import_set_state_nolock()) ffff9a8167963000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788836549.661356:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f535f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875730518751360:0@lo:39:umount.0 00000100:00100000:1.0:1788836549.661419:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836549.661494:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518751360 00000100:00100000:3.0:1788836549.661500:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518751360 00000100:00100000:3.0:1788836549.661541:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788836549.661548:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8167b32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730518751360:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788836549.661580:0:17182:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c7375715918 00000100:00080000:3.0:1788836549.661586:0:17182:0:(import.c:65:import_set_state_nolock()) ffff9a816c20b000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788836549.661602:0:17182:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000020:00000080:0.0:1788836549.662438:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a81646c1000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788836549.662520:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a81646c4000 for lustre-MDT0000 00000100:00100000:3.0:1788836549.663404:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8167b32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3617:x1875730518751360:12345-0@lo:39:umount.0 Request processed in 1849us (1978us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1788836549.663433:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00010000:3.0:1788836549.663488:0:17165:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788836549.663742:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9a8167963000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788836549.663751:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f535f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875730518751360:0@lo:39:umount.0 00000100:00080000:0.0:1788836549.663923:0:20765:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788836549.663927:0:20765:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:0.0:1788836549.663944:0:20765:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788836549.663997:0:20765:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788836549.664018:0:20765:0:(import.c:65:import_set_state_nolock()) ffff9a8179e95800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788836549.664037:0:20765:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788836549.664039:0:20765:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:0.0:1788836549.664047:0:20765:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788836549.664109:0:20765:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788836549.664119:0:20765:0:(import.c:65:import_set_state_nolock()) ffff9a8181add000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1788836549.664177:0:20765:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9a817f4d8000) has no exports 00000100:00100000:1.0:1788836549.664278:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875730518751488:0@lo:9:umount.0 00000100:00100000:1.0:1788836549.664334:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836549.664363:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875730518751616:0@lo:9:umount.0 00000100:00100000:1.0:1788836549.664397:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836549.664430:0:18697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518751488 00000100:00100000:1.0:1788836549.664436:0:18697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518751488 00000100:00100000:1.0:1788836549.664497:0:18697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518751616 00000100:00100000:1.0:1788836549.664507:0:18697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518751616 00000100:00100000:1.0:1788836549.664531:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788836549.664539:0:18697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8167b31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730518751488:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788836549.664836:0:18697:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c73757159e3 00000100:00080000:1.0:1788836549.664844:0:18697:0:(import.c:65:import_set_state_nolock()) ffff9a8046129800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788836549.664906:0:18697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1788836549.665025:0:18697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8167b31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3617:x1875730518751488:12345-0@lo:9:umount.0 Request processed in 486us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836549.665033:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788836549.665049:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788836549.665057:0:18697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8167b30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875730518751616:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788836549.665070:0:18697:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c7375715b3a 00000100:00080000:1.0:1788836549.665075:0:18697:0:(import.c:65:import_set_state_nolock()) ffff9a8046224800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788836549.665096:0:18697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1788836549.665176:0:18697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8167b30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3617:x1875730518751616:12345-0@lo:9:umount.0 Request processed in 120us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836549.665183:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:1.0:1788836549.665255:0:19379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788836549.665278:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9a8179e95800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788836549.665283:0:3617:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788836549.665285:0:3617:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788836549.665287:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875730518751488:0@lo:9:umount.0 00000100:00080000:1.0:1788836549.665297:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9a8181add000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788836549.665304:0:3617:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788836549.665305:0:3617:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788836549.665308:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875730518751616:0@lo:9:umount.0 00010000:00010000:0.0:1788836549.665372:0:19380:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788836549.676753:0:20765:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9a817f4d8000) has no exports 00000020:00000080:2.0:1788836549.750509:0:20765:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c737571576d 00000020:00000080:2.0:1788836549.750526:0:20765:0:(genops.c:885:class_export_put()) final put ffff9a804661b800/lustre-QMT0000_UUID 00000020:01000000:2.0:1788836549.750547:0:20765:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1788836549.750954:0:16590:0:(genops.c:844:class_export_destroy()) destroying export ffff9a804661b800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788836549.751147:0:20765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788836549.751158:0:20765:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788836549.751163:0:20765:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9a8167be8000) has no exports 00000020:00000080:3.0:1788836549.751741:0:20765:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c7375715766 00000020:00000080:3.0:1788836549.751749:0:20765:0:(genops.c:885:class_export_put()) final put ffff9a80471cf800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788836549.751808:0:20765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788836549.751826:0:20765:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788836549.751829:0:20765:0:(genops.c:885:class_export_put()) final put ffff9a804661a000/lustre-QMT0000_UUID 00000020:00000080:3.0:1788836549.751831:0:20765:0:(genops.c:844:class_export_destroy()) destroying export ffff9a804661a000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1788836549.751839:0:20765:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1788836549.752047:0:16590:0:(genops.c:844:class_export_destroy()) destroying export ffff9a80471cf800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:0.0:1788836549.989907:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8167b33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875730518751744:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788836549.989977:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836549.990230:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518751744 00000100:00100000:3.0:1788836549.990238:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518751744 00000100:00100000:3.0:1788836549.990284:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788836549.990292:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a816bd74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3620:x1875730518751744:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1788836549.990299:0:17182:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788836549.990354:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a816bd74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3620:x1875730518751744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 54us (368us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788836549.990361:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:02020000:1.0:1788836549.991693:0:3620:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:1.0:1788836549.999148:0:3620:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788836549.999157:0:3620:0:(import.c:65:import_set_state_nolock()) ffff9a8145931800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788836549.999163:0:3620:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788836550.031419:0:3620:0:(import.c:65:import_set_state_nolock()) ffff9a8145931800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788836550.031434:0:3620:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 492 00000100:00080000:1.0:1788836550.031446:0:3620:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9a8145931800 using connection 192.168.201.144@tcp/0@lo 00000100:00100000:1.0:1788836550.042624:0:3620:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8167b32d80 x1875730518751872/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788836550.042909:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8167b32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875730518751872:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788836550.042975:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836550.043887:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518751872 00000100:00100000:1.0:1788836550.043895:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518751872 00000100:00100000:1.0:1788836550.043937:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788836550.043945:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a816bd77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3617:x1875730518751872:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1788836550.043962:0:17182:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788836550.053245:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a816bd77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3617:x1875730518751872:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 9289us (10259us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788836550.053261:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:0.0:1788836550.053358:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9a8145931800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788836550.053363:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788836550.053367:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8167b32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875730518751872:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:1.0:1788836550.057215:0:17166:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788836551.020651:0:17923:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788836551.020670:0:17923:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:1.0:1788836551.020677:0:17923:0:(genops.c:885:class_export_put()) final put ffff9a8145f82000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788836551.020711:0:17923:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of eb7aabf5-9d6a-41ab-bbbe-35969986acd6 00000001:00080000:1.0:1788836551.020719:0:17923:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:1.0:1788836551.020722:0:17923:0:(genops.c:885:class_export_put()) final put ffff9a8166da0000/eb7aabf5-9d6a-41ab-bbbe-35969986acd6 00000001:00100000:1.0:1788836551.020734:0:17923:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of ee0d308b-6c11-4335-8f83-16d974416bdb 00000001:00100000:3.0:1788836551.020736:0:18691:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788836551.020740:0:17923:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:3.0:1788836551.020747:0:18691:0:(genops.c:885:class_export_put()) final put ffff9a804612b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788836551.020759:0:17923:0:(genops.c:885:class_export_put()) final put ffff9a804841f000/ee0d308b-6c11-4335-8f83-16d974416bdb 00000001:00100000:3.0:1788836551.020765:0:18691:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ee0d308b-6c11-4335-8f83-16d974416bdb 00000020:00000080:3.0:1788836551.020771:0:18691:0:(genops.c:885:class_export_put()) final put ffff9a8046312800/ee0d308b-6c11-4335-8f83-16d974416bdb 00000020:00000080:2.0:1788836551.020911:0:16590:0:(genops.c:844:class_export_destroy()) destroying export ffff9a8145f82000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1788836551.020966:0:16590:0:(genops.c:844:class_export_destroy()) destroying export ffff9a8166da0000/eb7aabf5-9d6a-41ab-bbbe-35969986acd6 for lustre-MDT0001 00000020:00000080:2.0:1788836551.021007:0:16590:0:(genops.c:844:class_export_destroy()) destroying export ffff9a804612b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788836551.021023:0:16590:0:(genops.c:844:class_export_destroy()) destroying export ffff9a804841f000/ee0d308b-6c11-4335-8f83-16d974416bdb for lustre-MDT0001 00000020:00000080:2.0:1788836551.021043:0:16590:0:(genops.c:844:class_export_destroy()) destroying export ffff9a8046312800/ee0d308b-6c11-4335-8f83-16d974416bdb for lustre-OST0000 00000020:00000080:2.0:1788836551.021057:0:16590:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a816c20b000 for lustre-MDT0001 00000020:00000080:2.0:1788836551.021062:0:16590:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a8166da0800 for lustre-MDT0001 00000020:00000080:2.0:1788836551.021073:0:16590:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a8046129800 for lustre-OST0000 00000020:00000080:2.0:1788836551.021077:0:16590:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a8046310000 for lustre-MDT0001 00000020:00000080:2.0:1788836551.021080:0:16590:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a8046317800 for lustre-OST0000 00000001:00100000:3.0:1788836551.021254:0:17157:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788836551.021258:0:17157:0:(genops.c:885:class_export_put()) final put ffff9a8151462800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1788836551.021278:0:17157:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of eb7aabf5-9d6a-41ab-bbbe-35969986acd6 00000001:00080000:3.0:1788836551.021284:0:17157:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:3.0:1788836551.021293:0:17157:0:(genops.c:885:class_export_put()) final put ffff9a8166da3800/eb7aabf5-9d6a-41ab-bbbe-35969986acd6 00000001:00100000:3.0:1788836551.021299:0:17157:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ee0d308b-6c11-4335-8f83-16d974416bdb 00000001:00080000:3.0:1788836551.021303:0:17157:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:3.0:1788836551.021311:0:17157:0:(genops.c:885:class_export_put()) final put ffff9a8045637000/ee0d308b-6c11-4335-8f83-16d974416bdb 00000020:00000080:0.0:1788836551.021486:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a8151462800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1788836551.021536:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a8166da3800/eb7aabf5-9d6a-41ab-bbbe-35969986acd6 for lustre-MDT0000 00000020:00000080:0.0:1788836551.021558:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a8045637000/ee0d308b-6c11-4335-8f83-16d974416bdb for lustre-MDT0000 00000020:00000080:0.0:1788836551.021583:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a81646c7800 for lustre-MDT0000 00000020:00000080:0.0:1788836551.021587:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a8166da1800 for lustre-MDT0000 00000020:00000080:0.0:1788836551.021590:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a8045630000 for lustre-MDT0000 00010000:00010000:3.0:1788836551.077952:0:17165:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788836551.781619:0:20765:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a8142ab9540 - data ffff9a815d5db000/ffff9a8166ddb800 00000020:01000000:3.0:1788836551.781808:0:20765:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a80476f7840 - data ffff9a8045834870/ffff9a8172f0cc00 00000001:00000004:3.0:1788836551.789262:0:20765:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000100:00080000:3.0:1788836551.871107:0:20765:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788836551.871117:0:20765:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788836551.871132:0:20765:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9a817f535f80 x1875730518751360/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788836559 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836551.871157:0:20765:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788836551.874971:0:20765:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788836551.874979:0:20765:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:3.0:1788836551.874994:0:20765:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788836551.874996:0:20765:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788836551.875537:0:17201:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788836551.875543:0:17201:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:0.0:1788836551.875552:0:17201:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1788836551.887963:0:20765:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788836551.887972:0:20765:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:3.0:1788836551.887996:0:20765:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788836551.887999:0:20765:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788836551.888437:0:17203:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788836551.888441:0:17203:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 1 count 1 00000040:00080000:0.0:1788836551.888451:0:17203:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:3.0:1788836551.898118:0:20765:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c7375715735 00000020:00000080:3.0:1788836551.898130:0:20765:0:(genops.c:885:class_export_put()) final put ffff9a8179f53800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788836551.900036:0:16590:0:(genops.c:844:class_export_destroy()) destroying export ffff9a8179f53800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788836551.918924:0:20765:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c737571574a 00000020:00000080:1.0:1788836551.918940:0:20765:0:(genops.c:885:class_export_put()) final put ffff9a8179f51800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788836551.918963:0:20765:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788836551.918969:0:20765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788836551.918977:0:20765:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788836551.918982:0:20765:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9a817f4d99b8) has no exports 00000004:01000000:1.0:1788836551.919164:0:20765:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788836551.919173:0:20765:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c73757157ac 00000020:00000080:1.0:1788836551.919177:0:20765:0:(genops.c:885:class_export_put()) final put ffff9a8179f51000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788836551.919181:0:20765:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788836551.919184:0:20765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788836551.919188:0:20765:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788836551.919191:0:20765:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9a815f600000) has no exports 00000020:00000080:1.0:1788836551.919199:0:20765:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c73757157a5 00000020:00000080:1.0:1788836551.919202:0:20765:0:(genops.c:885:class_export_put()) final put ffff9a8181adb800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788836551.919579:0:20765:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788836551.919583:0:20765:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788836551.919587:0:20765:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:1.0:1788836551.919592:0:20765:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788836551.919595:0:20765:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788836551.919628:0:20765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788836551.919634:0:20765:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788836551.919639:0:20765:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c7375715797 00000020:00000080:1.0:1788836551.919643:0:20765:0:(genops.c:885:class_export_put()) final put ffff9a804765c800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788836551.919646:0:20765:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788836551.919650:0:20765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788836551.919653:0:20765:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788836551.919655:0:20765:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9a804749b370) has no exports 00000020:00000080:1.0:1788836551.919659:0:20765:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c7375715790 00000020:00000080:1.0:1788836551.919661:0:20765:0:(genops.c:885:class_export_put()) final put ffff9a8179e91000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788836551.920196:0:20765:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788836551.920199:0:20765:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788836551.920202:0:20765:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:1.0:1788836551.920206:0:20765:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788836551.920207:0:20765:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788836551.920231:0:20765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788836551.920235:0:20765:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1788836551.920245:0:20765:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788836551.920249:0:20765:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c7375715782 00000020:00000080:1.0:1788836551.920254:0:20765:0:(genops.c:885:class_export_put()) final put ffff9a815f7e0800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788836551.920257:0:20765:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1788836551.920260:0:20765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788836551.920263:0:20765:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788836551.920266:0:20765:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff9a8167be99b8) has no exports 00000020:00000080:1.0:1788836551.920269:0:20765:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c737571577b 00000020:00000080:1.0:1788836551.920271:0:20765:0:(genops.c:885:class_export_put()) final put ffff9a8167966000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788836551.920642:0:16590:0:(genops.c:844:class_export_destroy()) destroying export ffff9a8179f51800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1788836551.920657:0:16590:0:(genops.c:844:class_export_destroy()) destroying export ffff9a8179f51000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788836551.920661:0:16590:0:(genops.c:844:class_export_destroy()) destroying export ffff9a8181adb800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788836551.920667:0:16590:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a8181add000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788836551.920673:0:16590:0:(genops.c:885:class_export_put()) final put ffff9a804765f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788836551.920675:0:16590:0:(genops.c:844:class_export_destroy()) destroying export ffff9a804765f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788836551.920697:0:16590:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788836551.920772:0:16590:0:(genops.c:844:class_export_destroy()) destroying export ffff9a804765c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788836551.920776:0:16590:0:(genops.c:844:class_export_destroy()) destroying export ffff9a8179e91000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788836551.920779:0:16590:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a8179e95800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788836551.920783:0:16590:0:(genops.c:885:class_export_put()) final put ffff9a8181ad9800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788836551.920785:0:16590:0:(genops.c:844:class_export_destroy()) destroying export ffff9a8181ad9800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1788836551.920788:0:16590:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788836551.920809:0:16590:0:(genops.c:844:class_export_destroy()) destroying export ffff9a815f7e0800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788836551.920813:0:16590:0:(genops.c:844:class_export_destroy()) destroying export ffff9a8167966000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788836551.927808:0:20765:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1788836551.927816:0:20765:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788836551.927820:0:20765:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788836551.927829:0:20765:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788836551.927949:0:20765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788836551.927976:0:20765:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788836551.928002:0:20765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788836551.928005:0:20765:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788836551.928011:0:20765:0:(genops.c:885:class_export_put()) final put ffff9a8181a76800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788836551.928015:0:20765:0:(genops.c:844:class_export_destroy()) destroying export ffff9a8181a76800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788836551.928027:0:20765:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788836551.928145:0:20765:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c7375715751 00000020:00000080:0.0:1788836551.928152:0:20765:0:(genops.c:885:class_export_put()) final put ffff9a8179f52000/lustre-MDD0000_UUID 00000020:01000000:0.0:1788836551.928157:0:20765:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788836551.928160:0:20765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788836551.928165:0:20765:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788836551.928169:0:20765:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9a817f4dcd28) has no exports 00000020:00000080:0.0:1788836551.928187:0:20765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788836551.928190:0:20765:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788836551.928194:0:20765:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c7375715758 00000020:00000080:0.0:1788836551.928197:0:20765:0:(genops.c:885:class_export_put()) final put ffff9a8179f50800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788836551.928205:0:20765:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a8047c9a800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788836551.928208:0:20765:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8047c9a800 3 00000020:01000004:0.0:1788836551.928212:0:20765:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a8047c9a800 from lustre-MDT0000 00000020:00000080:0.0:1788836551.928227:0:20765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788836551.928230:0:20765:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788836551.928233:0:20765:0:(genops.c:885:class_export_put()) final put ffff9a8179f57800/lustre-MDT0000_UUID 00000020:00000080:0.0:1788836551.928235:0:20765:0:(genops.c:844:class_export_destroy()) destroying export ffff9a8179f57800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788836551.928242:0:20765:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788836551.928268:0:20765:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1788836551.928271:0:20765:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788836551.928274:0:20765:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788836551.928276:0:20765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788836551.928279:0:20765:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788836551.928286:0:20765:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9a8181adf000 334968c0-1019-487d-94b4-b0d9e3b864ad 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788836551.928291:0:20765:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9a804749cd28) has exports, disconnecting them 00000020:00080000:0.0:1788836551.928295:0:20765:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9a8181adf000), last request at 1788836447 00000020:00000080:0.0:1788836551.928318:0:20765:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c73757156fd 00000020:00010000:0.0:1788836551.928322:0:20765:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9a8181adf000: total 2 00000100:00080000:0.0:1788836551.928326:0:20765:0:(import.c:65:import_set_state_nolock()) ffff9a8181ad8800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788836551.928354:0:20765:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a8181adf000): rc 0 00000020:00080000:0.0:1788836551.928357:0:20765:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9a804749cd28) has no exports 00000020:00000080:3.0:1788836551.928816:0:16590:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a8167963000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788836551.928827:0:16590:0:(genops.c:885:class_export_put()) final put ffff9a80471c9000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788836551.928829:0:16590:0:(genops.c:844:class_export_destroy()) destroying export ffff9a80471c9000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1788836551.928836:0:16590:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788836551.928984:0:16590:0:(genops.c:844:class_export_destroy()) destroying export ffff9a8179f52000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1788836551.928988:0:16590:0:(genops.c:885:class_export_put()) final put ffff9a8179f54000/lustre-MDD0000_UUID 00000020:00000080:3.0:1788836551.928990:0:16590:0:(genops.c:844:class_export_destroy()) destroying export ffff9a8179f54000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1788836551.928993:0:16590:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1788836551.929017:0:16590:0:(genops.c:844:class_export_destroy()) destroying export ffff9a8179f50800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:3.0:1788836551.929054:0:17170:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9a81456f3000:17170] 0 exiting: rc = 1 00000020:00010000:3.0:1788836551.929153:0:19379:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9a8181adf000: total 0 00010000:00010000:3.0:1788836551.929176:0:19379:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a8181adf000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1788836551.929220:0:19379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a80462e6200/0xbd163c7375715abc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbd163c7375715ab5 expref: 14 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836551.929238:0:19379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a80462e7e00/0xbd163c737571595e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbd163c7375715957 expref: 13 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836551.929250:0:19379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a814659d400/0xbd163c7375715ca6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbd163c7375715c9f expref: 12 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836551.929272:0:19379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a817f41a400/0xbd163c737571581c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbd163c7375715815 expref: 11 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836551.929285:0:19379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a814659ca00/0xbd163c7375715cc2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbd163c7375715cbb expref: 10 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836551.929295:0:19379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a817f41b800/0xbd163c7375715838 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbd163c7375715831 expref: 9 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836551.929303:0:19379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a80462e6800/0xbd163c7375715ae6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbd163c7375715adf expref: 8 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836551.929312:0:19379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a815158fc00/0xbd163c737571570b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbd163c7375715704 expref: 7 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836551.929321:0:19379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8141497600/0xbd163c7375715b25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbd163c7375715b1e expref: 6 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836551.929332:0:19379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a80462e7200/0xbd163c7375715988 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbd163c7375715981 expref: 5 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836551.929355:0:19379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a814659d800/0xbd163c7375715cb4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbd163c7375715cad expref: 4 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836551.929366:0:19379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a817f41ac00/0xbd163c73757158d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbd163c73757158d2 expref: 3 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836551.929378:0:19379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a814659c400/0xbd163c737571582a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbd163c7375715823 expref: 2 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836551.929401:0:19379:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a8181adf000, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1788836551.929415:0:19379:0:(genops.c:885:class_export_put()) final put ffff9a8181adf000/334968c0-1019-487d-94b4-b0d9e3b864ad 00010000:00010000:3.0:1788836551.929434:0:19379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836551.929437:0:19379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836551.929439:0:19379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836551.929492:0:17171:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9a8178c30200:17171] 1 exiting: rc = 0 00000020:00000080:0.0:1788836551.931036:0:16590:0:(genops.c:844:class_export_destroy()) destroying export ffff9a8181adf000/334968c0-1019-487d-94b4-b0d9e3b864ad for MGS 00000020:00000080:0.0:1788836551.931088:0:16590:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a8181ad8800 for MGS 00000100:00100000:0.0:1788836551.988606:0:17172:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9a81456f2c00:17172] 2 exiting: rc = 0 00000100:00100000:3.0:1788836551.988948:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.988957:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.988964:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.988971:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.988977:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.988984:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.988989:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.988994:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989000:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989006:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989012:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989017:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989023:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989029:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989034:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989040:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989046:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989052:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989057:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989063:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989069:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989075:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989081:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989086:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989091:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989097:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989121:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989128:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989134:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989139:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989144:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989149:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989154:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989159:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989164:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989172:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989178:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989182:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989187:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989194:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989199:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989218:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989225:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989230:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989234:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989248:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989253:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989259:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989264:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989270:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989276:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989282:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989289:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989294:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989300:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989305:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989310:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989314:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989452:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989682:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989755:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989771:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989775:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836551.989782:0:20765:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:3.0:1788836552.001750:0:20765:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a81678dec60 - data ffff9a815d5de798/ffff9a816c0ad400 00000020:01000000:3.0:1788836552.001921:0:20765:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a80474615a0 - data ffff9a815d5d1a20/ffff9a8181ba9000 00000020:00000080:3.0:1788836552.002682:0:20765:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c73757156e1 00000020:00000080:3.0:1788836552.002693:0:20765:0:(genops.c:885:class_export_put()) final put ffff9a8047c9c800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788836552.002713:0:20765:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a8047c9a800 from MGS, refs=2 00000020:01000004:3.0:1788836552.002719:0:20765:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8047c9a800 2 00000020:01000004:3.0:1788836552.002722:0:20765:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a8047c9a800 from MGS 00000020:00000080:3.0:1788836552.002745:0:20765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788836552.002752:0:20765:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788836552.002755:0:20765:0:(genops.c:885:class_export_put()) final put ffff9a8047c99800/MGS 00000020:00000080:3.0:1788836552.002758:0:20765:0:(genops.c:844:class_export_destroy()) destroying export ffff9a8047c99800/MGS for MGS 00000020:01000000:3.0:1788836552.002766:0:20765:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1788836552.002832:0:20765:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1788836552.002837:0:20765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788836552.002843:0:20765:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788836552.002849:0:20765:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9a814bfad800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788836552.002854:0:20765:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9a8047498000) has exports, disconnecting them 00000020:00080000:3.0:1788836552.002860:0:20765:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9a814bfad800), last request at 1788836448 00000020:00000080:3.0:1788836552.002863:0:20765:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c73757157e4 00000020:00080000:3.0:1788836552.003016:0:20765:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a814bfad800): rc 0 00000020:00000080:3.0:1788836552.003021:0:20765:0:(genops.c:885:class_export_put()) final put ffff9a814bfad800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788836552.003472:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a8047c9c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788836552.003481:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a814bfad800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1788836552.085444:0:20765:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1788836552.085453:0:20765:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788836552.085457:0:20765:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788836552.085642:0:20765:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788836552.085857:0:20765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788836552.085956:0:20765:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1788836552.085964:0:20765:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8047c9a800 1 00000020:00000080:3.0:1788836552.085981:0:20765:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c73757156d3 00000020:00000080:3.0:1788836552.085990:0:20765:0:(genops.c:885:class_export_put()) final put ffff9a8047c9f800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788836552.086022:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a8179e94000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788836552.086029:0:36:0:(genops.c:885:class_export_put()) final put ffff9a8179e96800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788836552.086032:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a8179e96800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788836552.086038:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:3.0:1788836552.086171:0:20765:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1788836552.086176:0:20765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788836552.086181:0:20765:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788836552.086185:0:20765:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9a80474999b8) has no exports 00000020:00000080:0.0:1788836552.087128:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a8047c9f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788836552.213732:0:20765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788836552.213748:0:20765:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1788836552.213755:0:20765:0:(genops.c:885:class_export_put()) final put ffff9a8047c9b800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788836552.213760:0:20765:0:(genops.c:844:class_export_destroy()) destroying export ffff9a8047c9b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788836552.213774:0:20765:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1788836552.213901:0:20765:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a8047c9c000 00000020:02000400:3.0:1788836552.213967:0:20765:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1788836552.224852:0:19380:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836553.255372:0:17166:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788836553.574078:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788836553.574085:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788836553.574089:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a8145931800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788836553.574097:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 580 00000100:00080000:1.0:1788836553.574103:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788836553.574109:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9a8145931800 using connection 192.168.201.144@tcp/0@lo 00000100:00100000:1.0:1788836553.574134:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8167b32d80 x1875730518752128/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788836553.574236:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875730518752512:0@lo:400:kworker.0 00000100:00100000:1.0:1788836553.574298:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836553.574360:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875730518753024:0@lo:400:kworker.0 00000100:00100000:1.0:1788836553.574394:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836553.574427:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788836553.574433:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8167b31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:334968c0-1019-487d-94b4-b0d9e3b864ad:3620:1875730518752000:0@lo:400:kworker.0 00000400:00000100:1.0:1788836553.574453:0:3620:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875730518752000 offset 0 length 224: 4 00000100:00100000:1.0:1788836553.574521:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875730518752640:0@lo:400:kworker.0 00000100:00100000:1.0:1788836553.574545:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836553.574571:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8167b32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875730518752128:0@lo:38:kworker.0 00000100:00100000:1.0:1788836553.574596:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836553.574624:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8166d8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875730518752256:0@lo:400:kworker.0 00000100:00100000:1.0:1788836553.574649:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836553.574666:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875730518752768:0@lo:400:kworker.0 00000100:00100000:1.0:1788836553.574686:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836553.574705:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788836553.574709:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875730518752384:0@lo:400:kworker.0 00000100:00100000:1.0:1788836553.574728:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836553.574742:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875730518752896:0@lo:400:kworker.0 00000100:00100000:1.0:1788836553.574760:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836553.574784:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518752512 00000100:00100000:1.0:1788836553.574792:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518752512 00000100:00100000:1.0:1788836553.574819:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518753024 00000100:00100000:1.0:1788836553.574822:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518753024 00000100:00100000:1.0:1788836553.574846:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518752640 00000100:00100000:1.0:1788836553.574848:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518752640 00000100:00100000:1.0:1788836553.574855:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518752768 00000100:00100000:1.0:1788836553.574857:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518752768 00000100:00100000:1.0:1788836553.574866:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518752896 00000100:00100000:1.0:1788836553.574869:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518752896 00000100:00100000:1.0:1788836553.574890:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788836553.574898:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8172d94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875730518753024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836553.574947:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8172d94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875730518753024:12345-0@lo:400:kworker.0 Request processed in 49us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836553.574954:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788836553.574971:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788836553.574977:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8172d96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875730518752768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836553.575006:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8172d96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875730518752768:12345-0@lo:400:kworker.0 Request processed in 30us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836553.575012:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788836553.575022:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788836553.575026:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8172d94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3620:x1875730518752512:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788836553.575031:0:17176:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788836553.575054:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8172d94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3620:x1875730518752512:12345-0@lo:400:kworker.0 Request processed in 27us (756us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788836553.575060:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788836553.575070:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788836553.575074:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8172d95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3620:x1875730518752640:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788836553.575078:0:17176:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788836553.575098:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8172d95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3620:x1875730518752640:12345-0@lo:400:kworker.0 Request processed in 23us (553us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788836553.575103:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788836553.575112:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788836553.575116:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8172d94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3618:x1875730518752896:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788836553.575120:0:17176:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788836553.575136:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8172d94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3618:x1875730518752896:12345-0@lo:400:kworker.0 Request processed in 19us (376us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788836553.575147:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788836553.575199:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518752128 00000100:00100000:1.0:1788836553.575203:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518752128 00000100:00100000:1.0:1788836553.575221:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788836553.575226:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8172d96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3617:x1875730518752128:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788836553.575243:0:17183:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788836553.575807:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875730518753152:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788836553.575842:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836553.575876:0:20219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518753152 00000100:00100000:0.0:1788836553.575879:0:20219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518753152 00000100:00100000:0.0:1788836553.575907:0:20219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788836553.575914:0:20219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a816bd74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875730518753152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788836553.575936:0:20219:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788836553.575970:0:20219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a816bd74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875730518753152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836553.575976:0:20219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788836553.576227:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875730518753152:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788836553.578277:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788836553.578287:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788836553.578305:0:19082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518752256 00000100:00100000:0.0:1788836553.578324:0:19082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518752256 00000100:00100000:0.0:1788836553.578385:0:19082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518752384 00000100:00100000:0.0:1788836553.578389:0:19082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518752384 00000100:00080000:2.0:1788836553.578550:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788836553.578791:0:19082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788836553.578801:0:19082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8172d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1875730518752256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836553.579266:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788836553.579278:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8172d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875730518752384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836553.579333:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8172d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875730518752384:12345-0@lo:400:kworker.0 Request processed in 59us (4603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836553.579341:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788836553.580624:0:19082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8172d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1875730518752256:12345-0@lo:400:kworker.0 Request processed in 89us (4238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836553.580644:0:19082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788836553.581626:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875730518752384:0@lo:400:kworker.0 00000100:00080000:2.0:1788836553.581642:0:3618:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788836553.581647:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a8045632000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788836553.581651:0:3618:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788836553.600794:0:3620:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788836553.600803:0:3620:0:(import.c:65:import_set_state_nolock()) ffff9a8046065000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788836553.600808:0:3620:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788836553.600815:0:3620:0:(import.c:65:import_set_state_nolock()) ffff9a8046065000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788836553.600819:0:3620:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 509 00000100:00080000:3.0:1788836553.600828:0:3620:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a8046065000 using connection 192.168.201.144@tcp/0@lo 00000100:00100000:3.0:1788836553.600863:0:3620:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a81412eb100 x1875730518753280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788836553.600893:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875730518752640:0@lo:400:kworker.0 00000100:00080000:3.0:1788836553.600926:0:3620:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788836553.600929:0:3620:0:(import.c:65:import_set_state_nolock()) ffff9a8047481800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788836553.600932:0:3620:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788836553.600936:0:3620:0:(import.c:65:import_set_state_nolock()) ffff9a8047481800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788836553.600939:0:3620:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 493 00000100:00080000:3.0:1788836553.600943:0:3620:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9a8047481800 using connection 192.168.201.144@tcp/0@lo 00000100:00100000:3.0:1788836553.600957:0:3620:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a81412e8700 x1875730518753408/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788836553.600968:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875730518752512:0@lo:400:kworker.0 00010000:00080000:3.0:1788836553.600984:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9a8172d95c00 x1875730518753024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836569 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836553.600994:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875730518753024:0@lo:400:kworker.0 00000100:00100000:3.0:1788836553.601049:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a81412eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3617:1875730518753280:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1788836553.601114:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836553.601149:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a81412e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875730518753408:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1788836553.602451:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836553.602531:0:19980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518753280 00000100:00100000:3.0:1788836553.602538:0:19980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518753280 00000100:00100000:3.0:1788836553.602570:0:19980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518753408 00000100:00100000:3.0:1788836553.602573:0:19980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518753408 00000100:00100000:3.0:1788836553.602591:0:19980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788836553.602598:0:19980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81412e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3617:x1875730518753280:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:3.0:1788836553.602620:0:19980:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788836553.602673:0:19980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81412e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3617:x1875730518753280:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 74us (1558us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788836553.602681:0:19980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788836553.602698:0:19980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788836553.602702:0:19980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81412eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3617:x1875730518753408:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:3.0:1788836553.602713:0:19980:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788836553.602736:0:19980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81412eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3617:x1875730518753408:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 32us (289us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788836553.602742:0:19980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1788836553.602774:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9a8046065000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788836553.602780:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788836553.602783:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a81412eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3617:1875730518753280:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:3.0:1788836553.602790:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9a8047481800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788836553.602793:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788836553.602796:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a81412e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875730518753408:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788836553.611567:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8172d96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3617:x1875730518752128:12345-0@lo:38:kworker.0 Request processed in 36333us (36962us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788836553.611580:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:0.0:1788836553.611784:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9a8145931800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788836553.611790:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788836553.611795:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8167b32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875730518752128:0@lo:38:kworker.0 00000100:00080000:2.0:1788836553.651738:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9a8045632000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788836553.651753:0:3618:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 527 00000100:00080000:2.0:1788836553.651763:0:3618:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a8045632000 using connection 192.168.201.144@tcp/0@lo 00000100:00100000:2.0:1788836553.651854:0:3618:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a817f535f80 x1875730518753536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788836553.651939:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875730518752896:0@lo:400:kworker.0 00000100:00100000:2.0:1788836553.651982:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8166d8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875730518752256:0@lo:400:kworker.0 00010000:00080000:2.0:1788836553.651994:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9a8172d95500 x1875730518752768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836569 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836553.652003:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875730518752768:0@lo:400:kworker.0 00000100:00100000:0.0:1788836553.654153:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f535f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3617:1875730518753536:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788836553.654403:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836553.657415:0:19980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518753536 00000100:00100000:2.0:1788836553.657429:0:19980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518753536 00000100:00100000:2.0:1788836553.657499:0:19980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788836553.657507:0:19980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a816bd76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3617:x1875730518753536:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1788836553.657529:0:19980:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788836553.657629:0:19980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a816bd76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3617:x1875730518753536:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 121us (3227us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788836553.657636:0:19980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1788836553.658886:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9a8045632000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788836553.658897:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788836553.658901:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f535f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3617:1875730518753536:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:1.0:1788836554.277600:0:17165:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836554.597760:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788836554.597793:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f535180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875730518753664:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788836554.597912:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836554.598074:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518753664 00000100:00100000:2.0:1788836554.598086:0:18698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518753664 00000100:00100000:2.0:1788836554.598161:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788836554.598174:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a816bd75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875730518753664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788836554.598224:0:18698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788836554.598287:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a816bd75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875730518753664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 115us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836554.598306:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788836554.598506:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f535180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875730518753664:0@lo:13:osp-pre-0-1.0 00000040:00080000:1.0:1788836555.257057:0:17943:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788836555.305605:0:19379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788836556.137201:0:19511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788836556.137215:0:19511:0:(genops.c:885:class_export_put()) final put ffff9a8046227000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788836556.137377:0:16590:0:(genops.c:844:class_export_destroy()) destroying export ffff9a8046227000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788836556.137810:0:16590:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a8046224800 for lustre-OST0001 00010000:00010000:1.0:1788836556.326980:0:19380:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788836556.556319:0:20966:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788836556.566721:0:20966:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1788836556.566773:0:20966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a80462e7800/0xbd163c73757158d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c73757158d9 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836556.566785:0:20966:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a80462e7800/0xbd163c73757158d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd163c73757158d9 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836556.566791:0:20966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a80462e7800/0xbd163c73757158d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd163c73757158d9 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836556.566795:0:20966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.144@tcp lock: ffff9a80462e7800/0xbd163c73757158d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd163c73757158d9 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836556.566812:0:20966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788836556.566817:0:20966:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788836556.566850:0:20966:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788836556.566854:0:20966:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788836556.566858:0:20966:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788836556.566874:0:20966:0:(import.c:65:import_set_state_nolock()) ffff9a8047481800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788836556.566878:0:20966:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788836556.566879:0:20966:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788836556.566881:0:20966:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788836556.567377:0:17166:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836556.567385:0:17166:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.144@tcp lock: ffff9a80462e7800/0xbd163c73757158d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd163c73757158d9 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836556.567394:0:17166:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a80462e7800 already unused, calling callback (ffffffffc139ec20) 10000000:00010000:1.0:1788836556.567397:0:17166:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.144@tcp lock: ffff9a80462e7800/0xbd163c73757158d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd163c73757158d9 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836556.567407:0:17166:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.144@tcp lock: ffff9a80462e7800/0xbd163c73757158d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xbd163c73757158d9 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788836556.567415:0:17166:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.144@tcp lock: ffff9a80462e7800/0xbd163c73757158d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xbd163c73757158d9 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836556.567434:0:17166:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788836556.567437:0:17166:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788836556.567439:0:17166:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788836556.567518:0:17166:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.144@tcp lock: ffff9a80462e7800/0xbd163c73757158d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd163c73757158d9 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836556.567525:0:17166:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788836556.567548:0:17166:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.144@tcp lock: ffff9a80462e7800/0xbd163c73757158d2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd163c73757158d9 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836556.567555:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.144@tcp lock: ffff9a80462e7800/0xbd163c73757158d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd163c73757158d9 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836556.567567:0:17166:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836556.567569:0:17166:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836556.567570:0:17166:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836556.567647:0:20966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a80462e7c00/0xbd163c7375715831 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375715838 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836556.567653:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:334968c0-1019-487d-94b4-b0d9e3b864ad:3619:1875730518753792:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788836556.567655:0:20966:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a80462e7c00/0xbd163c7375715831 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd163c7375715838 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836556.567661:0:20966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a80462e7c00/0xbd163c7375715831 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd163c7375715838 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836556.567667:0:20966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.144@tcp lock: ffff9a80462e7c00/0xbd163c7375715831 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd163c7375715838 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836556.567684:0:20966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788836556.567689:0:20966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a814659de00/0xbd163c7375715b1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375715b25 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836556.567695:0:20966:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a814659de00/0xbd163c7375715b1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd163c7375715b25 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836556.567700:0:20966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a814659de00/0xbd163c7375715b1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd163c7375715b25 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836556.567706:0:20966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.144@tcp lock: ffff9a814659de00/0xbd163c7375715b1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd163c7375715b25 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836556.567728:0:20966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1788836556.567729:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788836556.567738:0:19379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788836556.567742:0:19379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.144@tcp lock: ffff9a80462e7c00/0xbd163c7375715831 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd163c7375715838 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836556.567748:0:19379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a80462e7c00 already unused, calling callback (ffffffffc139ec20) 10000000:00010000:2.0:1788836556.567751:0:19379:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.144@tcp lock: ffff9a80462e7c00/0xbd163c7375715831 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd163c7375715838 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836556.567757:0:19379:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.144@tcp lock: ffff9a80462e7c00/0xbd163c7375715831 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xbd163c7375715838 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788836556.567762:0:19379:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.144@tcp lock: ffff9a80462e7c00/0xbd163c7375715831 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xbd163c7375715838 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836556.567767:0:19379:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788836556.567769:0:19379:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:2.0:1788836556.567782:0:19379:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.144@tcp lock: ffff9a80462e7c00/0xbd163c7375715831 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd163c7375715838 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836556.567787:0:19379:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788836556.567802:0:19379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.144@tcp lock: ffff9a80462e7c00/0xbd163c7375715831 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd163c7375715838 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836556.567803:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518753792 00010000:00010000:2.0:1788836556.567808:0:19379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.144@tcp lock: ffff9a80462e7c00/0xbd163c7375715831 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd163c7375715838 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836556.567809:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518753792 00010000:00010000:2.0:1788836556.567817:0:19379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836556.567820:0:19379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.144@tcp lock: ffff9a814659de00/0xbd163c7375715b1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd163c7375715b25 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836556.567830:0:19379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a814659de00 already unused, calling callback (ffffffffc139ec20) 10000000:00010000:2.0:1788836556.567833:0:19379:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.144@tcp lock: ffff9a814659de00/0xbd163c7375715b1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd163c7375715b25 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836556.567838:0:19379:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.144@tcp lock: ffff9a814659de00/0xbd163c7375715b1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xbd163c7375715b25 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836556.567842:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 10000000:00010000:2.0:1788836556.567845:0:19379:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.144@tcp lock: ffff9a814659de00/0xbd163c7375715b1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xbd163c7375715b25 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836556.567849:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a816bd74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3619:x1875730518753792:12345-0@lo:103:ldlm_bl.0 10000000:01000000:2.0:1788836556.567850:0:19379:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788836556.567852:0:19379:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788836556.567854:0:19379:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00020000:0.0:1788836556.567855:0:17163:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788836556 with bad export cookie 13625144189245282045 00010000:00010000:2.0:1788836556.567866:0:19379:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.144@tcp lock: ffff9a814659de00/0xbd163c7375715b1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd163c7375715b25 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836556.567871:0:19379:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788836556.567876:0:19379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.144@tcp lock: ffff9a814659de00/0xbd163c7375715b1e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd163c7375715b25 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836556.567881:0:19379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.144@tcp lock: ffff9a814659de00/0xbd163c7375715b1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd163c7375715b25 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836556.567894:0:19379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836556.567896:0:19379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836556.567897:0:19379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836556.567907:0:20966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a8167974c00/0xbd163c7375715cbb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375715cc2 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836556.567913:0:20966:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a8167974c00/0xbd163c7375715cbb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd163c7375715cc2 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836556.567925:0:20966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a8167974c00/0xbd163c7375715cbb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd163c7375715cc2 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836556.567932:0:20966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.144@tcp lock: ffff9a8167974c00/0xbd163c7375715cbb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd163c7375715cc2 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836556.567943:0:20966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788836556.567948:0:20966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a815158e400/0xbd163c7375715823 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c737571582a expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836556.567955:0:20966:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a815158e400/0xbd163c7375715823 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd163c737571582a expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836556.567961:0:20966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a815158e400/0xbd163c7375715823 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd163c737571582a expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836556.567967:0:20966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.144@tcp lock: ffff9a815158e400/0xbd163c7375715823 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd163c737571582a expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836556.567975:0:20966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788836556.567978:0:20966:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:2.0:1788836556.567981:0:20966:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:2.0:1788836556.568002:0:20966:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1788836556.568006:0:20966:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:2.0:1788836556.568010:0:20966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788836556.568016:0:20966:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1788836556.568021:0:20966:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9a8045636000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788836556.568027:0:20966:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9a804612d800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788836556.568040:0:20966:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9a816be30000) has exports, disconnecting them 00000020:00080000:2.0:1788836556.568045:0:20966:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9a8045636000), last request at 1788836553 00000020:00000080:2.0:1788836556.568051:0:20966:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c7375715b10 00000100:00080000:2.0:1788836556.568066:0:20966:0:(import.c:65:import_set_state_nolock()) ffff9a8045637800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788836556.568102:0:19379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788836556.568106:0:19379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.144@tcp lock: ffff9a8167974c00/0xbd163c7375715cbb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd163c7375715cc2 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836556.568112:0:19379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8167974c00 already unused, calling callback (ffffffffc139ec20) 10000000:00010000:2.0:1788836556.568115:0:19379:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.144@tcp lock: ffff9a8167974c00/0xbd163c7375715cbb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd163c7375715cc2 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836556.568123:0:19379:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.144@tcp lock: ffff9a8167974c00/0xbd163c7375715cbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xbd163c7375715cc2 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788836556.568129:0:19379:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.144@tcp lock: ffff9a8167974c00/0xbd163c7375715cbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xbd163c7375715cc2 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836556.568135:0:19379:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788836556.568137:0:19379:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788836556.568138:0:19379:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788836556.568152:0:19379:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.144@tcp lock: ffff9a8167974c00/0xbd163c7375715cbb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd163c7375715cc2 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836556.568158:0:19379:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788836556.568169:0:19379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.144@tcp lock: ffff9a8167974c00/0xbd163c7375715cbb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd163c7375715cc2 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836556.568176:0:19379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.144@tcp lock: ffff9a8167974c00/0xbd163c7375715cbb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd163c7375715cc2 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836556.568195:0:19379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836556.568198:0:19379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.144@tcp lock: ffff9a815158e400/0xbd163c7375715823 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd163c737571582a expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836556.568204:0:19379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a815158e400 already unused, calling callback (ffffffffc139ec20) 10000000:00010000:2.0:1788836556.568207:0:19379:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.144@tcp lock: ffff9a815158e400/0xbd163c7375715823 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd163c737571582a expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836556.568214:0:19379:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.144@tcp lock: ffff9a815158e400/0xbd163c7375715823 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xbd163c737571582a expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788836556.568221:0:19379:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.144@tcp lock: ffff9a815158e400/0xbd163c7375715823 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xbd163c737571582a expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836556.568226:0:19379:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788836556.568228:0:19379:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788836556.568230:0:19379:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788836556.568242:0:19379:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.144@tcp lock: ffff9a815158e400/0xbd163c7375715823 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd163c737571582a expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836556.568248:0:19379:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788836556.568254:0:19379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.144@tcp lock: ffff9a815158e400/0xbd163c7375715823 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd163c737571582a expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836556.568279:0:19379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.144@tcp lock: ffff9a815158e400/0xbd163c7375715823 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbd163c737571582a expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836556.568289:0:19379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836556.568291:0:19379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836556.568299:0:19379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788836556.568314:0:20966:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a8045636000): rc 0 00000020:00000080:2.0:1788836556.568317:0:20966:0:(genops.c:885:class_export_put()) final put ffff9a8045636000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:2.0:1788836556.568327:0:20966:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9a804612d800), last request at 1788836553 00000020:00000080:2.0:1788836556.568331:0:20966:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c73757159b2 00000100:00080000:2.0:1788836556.568336:0:20966:0:(import.c:65:import_set_state_nolock()) ffff9a804612e800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788836556.568347:0:19379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788836556.568354:0:20966:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a804612d800): rc 0 00000020:00000080:2.0:1788836556.568356:0:20966:0:(genops.c:885:class_export_put()) final put ffff9a804612d800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:2.0:1788836556.568364:0:20966:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffae36c1cafae0 00000100:00080000:2.0:1788836556.568381:0:20966:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788836556.568390:0:20966:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9a8167b33800 x1875730518751744/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788836565 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836556.568400:0:20966:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788836556.569353:0:20966:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788836556.569374:0:20966:0:(import.c:65:import_set_state_nolock()) ffff9a8145931800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:1.0:1788836556.570344:0:17165:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836556.570361:0:19380:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836556.570366:0:17166:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836556.570443:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f535180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:334968c0-1019-487d-94b4-b0d9e3b864ad:3618:1875730518754176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788836556.570521:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f536a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:334968c0-1019-487d-94b4-b0d9e3b864ad:3621:1875730518754048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788836556.570584:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836556.570635:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788836556.570641:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f534700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:334968c0-1019-487d-94b4-b0d9e3b864ad:3621:1875730518753920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788836556.570662:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836556.570693:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8167b33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875730518751744:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788836556.570728:0:20220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518754048 00000100:00100000:1.0:1788836556.570735:0:20220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518754048 00000100:00100000:1.0:1788836556.570768:0:20220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518753920 00000100:00100000:1.0:1788836556.570783:0:20220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518753920 00000100:00100000:1.0:1788836556.570801:0:20220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788836556.570807:0:20220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8172d96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3621:x1875730518754048:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788836556.570812:0:20220:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788836556 with bad export cookie 13625144189245282045 00000100:00100000:1.0:1788836556.570858:0:20220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8172d96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3621:x1875730518754048:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (274us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788836556.570877:0:20220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788836556.570895:0:20220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788836556.570899:0:20220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8172d95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3621:x1875730518753920:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788836556.570903:0:20220:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788836556 with bad export cookie 13625144189245282045 00000100:00100000:1.0:1788836556.570928:0:20220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8172d95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3621:x1875730518753920:12345-0@lo:103:ldlm_bl.0 Request processed in 28us (266us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788836556.570934:0:20220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1788836556.570964:0:3621:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.144@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788836556.570968:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9a8047df4800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788836556.570972:0:3621:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.144@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:3.0:1788836556.571248:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836556.571290:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788836556.571322:0:20220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518754176 00000100:00100000:2.0:1788836556.571326:0:20220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518754176 00000100:00100000:2.0:1788836556.571347:0:20220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788836556.571352:0:20220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81412e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3618:x1875730518754176:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788836556.571357:0:20220:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788836556 with bad export cookie 13625144189245282045 00000100:00100000:2.0:1788836556.571387:0:20220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81412e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3618:x1875730518754176:12345-0@lo:103:ldlm_bl.0 Request processed in 34us (139us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788836556.571393:0:20220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000020:00000080:2.0:1788836556.573567:0:16590:0:(genops.c:844:class_export_destroy()) destroying export ffff9a8045636000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:2.0:1788836556.573638:0:16590:0:(genops.c:844:class_export_destroy()) destroying export ffff9a804612d800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:2.0:1788836556.573668:0:16590:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a8045637800 for lustre-MDT0001 00000020:00000080:2.0:1788836556.573673:0:16590:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a804612e800 for lustre-MDT0001 00000100:00080000:1.0:1788836556.575286:0:3621:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.144@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788836556.575292:0:3621:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788836556.575302:0:3621:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a8167b31500 x1875730518752000/t0(0) o400->MGC192.168.201.144@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788836569 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836556.575324:0:3621:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a8172d97100 x1875730518753792/t0(0) o103->MGC192.168.201.144@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788836572 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836556.575335:0:3621:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a817f535180 x1875730518754176/t0(0) o103->MGC192.168.201.144@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788836572 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836556.575343:0:3621:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a817f536a00 x1875730518754048/t0(0) o103->MGC192.168.201.144@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788836572 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836556.575353:0:3621:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a817f534700 x1875730518753920/t0(0) o103->MGC192.168.201.144@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788836572 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788836556.575380:0:3621:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788836556.575383:0:3621:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788836556.575385:0:3621:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788836556.575959:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f535f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:334968c0-1019-487d-94b4-b0d9e3b864ad:0:1875730518754304:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788836556.575982:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f535180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:334968c0-1019-487d-94b4-b0d9e3b864ad:3618:1875730518754176:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788836556.576244:0:20966:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788836556.576248:0:20966:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1788836556.576310:0:20966:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788836556.576374:0:20966:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788836556.576399:0:20966:0:(import.c:65:import_set_state_nolock()) ffff9a8146098800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788836556.576645:0:20966:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788836556.576649:0:20966:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1788836556.576692:0:20966:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788836556.576754:0:20966:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788836556.576766:0:20966:0:(import.c:65:import_set_state_nolock()) ffff9a80414ba800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788836556.576805:0:20966:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9a816be30000) has no exports 00000100:00080000:1.0:1788836556.577353:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9a8047df4800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788836556.577362:0:3621:0:(import.c:510:import_select_connection()) MGC192.168.201.144@tcp: connect to NID 0@lo last attempt 477 00000100:00080000:1.0:1788836556.577371:0:3621:0:(import.c:624:import_select_connection()) MGC192.168.201.144@tcp: import ffff9a8047df4800 using connection 192.168.201.144@tcp/0@lo 00000100:00100000:1.0:1788836556.577395:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8167b31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:334968c0-1019-487d-94b4-b0d9e3b864ad:3620:1875730518752000:0@lo:400:kworker.0 00000100:00100000:1.0:1788836556.577531:0:3621:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8172d95500 x1875730518754688/t0(0) o250->MGC192.168.201.144@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788836556.577551:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f536a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:334968c0-1019-487d-94b4-b0d9e3b864ad:3621:1875730518754048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788836556.577564:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f534700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:334968c0-1019-487d-94b4-b0d9e3b864ad:3621:1875730518753920:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788836556.578247:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f535180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875730518754432:0@lo:9:umount.0 00000100:00100000:0.0:1788836556.578319:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836556.578352:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f535f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875730518754560:0@lo:9:umount.0 00000100:00100000:3.0:1788836556.578359:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518754432 00000100:00100000:3.0:1788836556.578366:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518754432 00000100:00100000:0.0:1788836556.578374:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836556.578401:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:334968c0-1019-487d-94b4-b0d9e3b864ad:3617:1875730518754688:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:0.0:1788836556.578416:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875730518754688 offset 0 length 520: 4 00000100:00100000:3.0:1788836556.578419:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518754560 00000100:00100000:3.0:1788836556.578430:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518754560 00000100:00100000:0.0:1788836556.578455:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:334968c0-1019-487d-94b4-b0d9e3b864ad:3619:1875730518753792:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788836556.578456:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788836556.578486:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a816bd75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730518754432:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788836556.578508:0:18695:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c73757159dc 00000400:00000100:0.0:1788836556.578514:0:17163:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1875730518753792 offset 224 length 224: 4 00000100:00080000:3.0:1788836556.578516:0:18695:0:(import.c:65:import_set_state_nolock()) ffff9a804841d800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788836556.578524:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a816bd74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3619:x1875730518753792:12345-0@lo:103:ldlm_bl.0 Request processed in 10674us (10795us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788836556.578531:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000001:00000004:3.0:1788836556.578547:0:18695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1788836556.578680:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a816bd75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3617:x1875730518754432:12345-0@lo:9:umount.0 Request processed in 197us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836556.578681:0:19082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788836556.578686:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788836556.578689:0:19082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a816bd76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1875730518754560:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788836556.578701:0:19082:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c7375715b41 00000100:00080000:1.0:1788836556.578706:0:19082:0:(import.c:65:import_set_state_nolock()) ffff9a8046220800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788836556.578735:0:19082:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00080000:2.0:1788836556.578768:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788836556.578772:0:17173:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788836556.578778:0:19379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836556.578813:0:19082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a816bd76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3617:x1875730518754560:12345-0@lo:9:umount.0 Request processed in 126us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836556.578818:0:19082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:1.0:1788836556.578830:0:17165:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788836556.578878:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9a8146098800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788836556.578896:0:3617:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788836556.578898:0:3617:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788836556.578901:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f535180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875730518754432:0@lo:9:umount.0 00000100:00080000:0.0:1788836556.578912:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9a80414ba800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788836556.578976:0:3617:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788836556.579020:0:3617:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788836556.579024:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f535f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875730518754560:0@lo:9:umount.0 00000020:00080000:2.0:1788836556.587177:0:20966:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9a816be30000) has no exports 00000020:01000000:3.0:1788836556.612456:0:20966:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a8142ab98a0 - data ffff9a80458a06c0/ffff9a8166dd8c00 00000020:01000000:3.0:1788836556.612654:0:20966:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a80471788a0 - data ffff9a8149ea2000/ffff9a816c1bbc00 00000001:00000004:3.0:1788836556.621037:0:20966:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:3.0:1788836556.651039:0:20966:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788836556.651049:0:20966:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788836556.651056:0:20966:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788836556.653029:0:20966:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788836556.653036:0:20966:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1788836556.653120:0:20966:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788836556.653124:0:20966:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788836556.653370:0:17931:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788836556.653376:0:17931:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:0.0:1788836556.653397:0:17931:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1788836556.654159:0:20966:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788836556.654164:0:20966:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1788836556.654213:0:20966:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788836556.654215:0:20966:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788836556.654435:0:17933:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788836556.654439:0:17933:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:1.0:1788836556.654447:0:17933:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:3.0:1788836556.655797:0:20966:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c7375715846 00000020:00000080:3.0:1788836556.655807:0:20966:0:(genops.c:885:class_export_put()) final put ffff9a8179f55000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788836556.656456:0:20966:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c737571585b 00000020:00000080:3.0:1788836556.656517:0:20966:0:(genops.c:885:class_export_put()) final put ffff9a80475e8800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788836556.656549:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a8179f55000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1788836556.656601:0:20966:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1788836556.656614:0:20966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788836556.656622:0:20966:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788836556.656634:0:20966:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9a816be33370) has no exports 00000004:01000000:3.0:1788836556.656910:0:20966:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788836556.656920:0:20966:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c73757158af 00000020:00000080:3.0:1788836556.656925:0:20966:0:(genops.c:885:class_export_put()) final put ffff9a8145937000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788836556.656947:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a80475e8800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1788836556.657009:0:20966:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788836556.657014:0:20966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788836556.657018:0:20966:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788836556.657021:0:20966:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9a816c10cd28) has no exports 00000020:00000080:3.0:1788836556.657026:0:20966:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c73757158a8 00000020:00000080:3.0:1788836556.657029:0:20966:0:(genops.c:885:class_export_put()) final put ffff9a80414ba000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788836556.657047:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a8145937000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00010000:01000000:3.0:1788836556.657427:0:20966:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1788836556.657432:0:20966:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788836556.657436:0:20966:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1788836556.657440:0:20966:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788836556.657442:0:20966:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788836556.657517:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a80414ba000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788836556.657594:0:20966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788836556.657600:0:20966:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788836556.657613:0:20966:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c737571589a 00000020:00000080:3.0:1788836556.657617:0:20966:0:(genops.c:885:class_export_put()) final put ffff9a8158dbc000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788836556.657730:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a80414ba800 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1788836556.657736:0:37:0:(genops.c:885:class_export_put()) final put ffff9a80475ef000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788836556.657738:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a80475ef000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1788836556.657743:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788836556.657837:0:20966:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:0.0:1788836556.657877:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a8158dbc000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788836556.657896:0:20966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788836556.657901:0:20966:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788836556.657903:0:20966:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9a8167becd28) has no exports 00000020:00000080:3.0:1788836556.657907:0:20966:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c737571588c 00000020:00000080:3.0:1788836556.657911:0:20966:0:(genops.c:885:class_export_put()) final put ffff9a8158db8800/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1788836556.658283:0:20966:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1788836556.658287:0:20966:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788836556.658289:0:20966:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1788836556.658293:0:20966:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788836556.658294:0:20966:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788836556.658316:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a8158db8800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788836556.658381:0:20966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788836556.658386:0:20966:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1788836556.658406:0:20966:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788836556.658411:0:20966:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c737571587e 00000020:00000080:3.0:1788836556.658415:0:20966:0:(genops.c:885:class_export_put()) final put ffff9a8145930000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788836556.658435:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a8146098800 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1788836556.658440:0:37:0:(genops.c:885:class_export_put()) final put ffff9a80414bb000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788836556.658442:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a80414bb000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1788836556.658446:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788836556.658563:0:20966:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1788836556.658566:0:20966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788836556.658570:0:20966:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788836556.658572:0:20966:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9a817f3fb370) has no exports 00000020:00000080:3.0:1788836556.658577:0:20966:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c7375715877 00000020:00000080:3.0:1788836556.658580:0:20966:0:(genops.c:885:class_export_put()) final put ffff9a8145933800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788836556.659969:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a8145930000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1788836556.659980:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a8145933800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1788836556.662996:0:20966:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:3.0:1788836556.663006:0:20966:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788836556.663011:0:20966:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788836556.663019:0:20966:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788836556.663113:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a8145931800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788836556.663152:0:20966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788836556.663162:0:20966:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788836556.663167:0:20966:0:(genops.c:885:class_export_put()) final put ffff9a8158dbc800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788836556.663170:0:20966:0:(genops.c:844:class_export_destroy()) destroying export ffff9a8158dbc800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1788836556.663177:0:20966:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788836556.663376:0:20966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788836556.663381:0:20966:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788836556.663384:0:20966:0:(genops.c:885:class_export_put()) final put ffff9a814609e000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788836556.663386:0:20966:0:(genops.c:844:class_export_destroy()) destroying export ffff9a814609e000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1788836556.663389:0:20966:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788836556.663572:0:20966:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c7375715862 00000020:00000080:3.0:1788836556.663579:0:20966:0:(genops.c:885:class_export_put()) final put ffff9a80475eb800/lustre-MDD0001_UUID 00000020:01000000:3.0:1788836556.663616:0:20966:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:3.0:1788836556.663620:0:20966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788836556.663625:0:20966:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788836556.663629:0:20966:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9a816be319b8) has no exports 00000020:00000080:3.0:1788836556.663712:0:20966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788836556.663717:0:20966:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:3.0:1788836556.663731:0:20966:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c7375715869 00000020:00000080:3.0:1788836556.663736:0:20966:0:(genops.c:885:class_export_put()) final put ffff9a80475e9800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788836556.663817:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a80475eb800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:0.0:1788836556.663821:0:37:0:(genops.c:885:class_export_put()) final put ffff9a80475ee000/lustre-MDD0001_UUID 00000020:00000080:0.0:1788836556.663823:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a80475ee000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:0.0:1788836556.663831:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:01000004:3.0:1788836556.664013:0:20966:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a804602d800 from lustre-MDT0001, refs=2 00000020:01000004:3.0:1788836556.664017:0:20966:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a804602d800 2 00000020:01000004:3.0:1788836556.664020:0:20966:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a804602d800 from lustre-MDT0001 00000020:00000080:3.0:1788836556.664039:0:20966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788836556.664042:0:20966:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:3.0:1788836556.664045:0:20966:0:(genops.c:885:class_export_put()) final put ffff9a814609f800/lustre-MDT0001_UUID 00000020:00000080:3.0:1788836556.664047:0:20966:0:(genops.c:844:class_export_destroy()) destroying export ffff9a814609f800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:3.0:1788836556.664052:0:20966:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:3.0:1788836556.664077:0:20966:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:3.0:1788836556.664080:0:20966:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:3.0:1788836556.664083:0:20966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788836556.664086:0:20966:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788836556.664093:0:20966:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9a8047483800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788836556.664097:0:20966:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff9a815f603370) has exports, disconnecting them 00000020:00080000:3.0:1788836556.664101:0:20966:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9a8047483800), last request at 1788836462 00000020:00000080:3.0:1788836556.664105:0:20966:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c73757158e7 00000020:00080000:3.0:1788836556.664114:0:20966:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a8047483800): rc 0 00000020:00000080:3.0:1788836556.664117:0:20966:0:(genops.c:885:class_export_put()) final put ffff9a8047483800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1788836556.664139:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a80475e9800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788836556.665142:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a8047483800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:0.0:1788836556.665522:0:20966:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:0.0:1788836556.665526:0:20966:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788836556.665541:0:20966:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788836556.665546:0:20966:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788836556.665691:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a8047481800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1788836556.665890:0:20966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788836556.665897:0:20966:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:0.0:1788836556.665905:0:20966:0:(genops.c:885:class_export_put()) final put ffff9a8047484000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:0.0:1788836556.665907:0:20966:0:(genops.c:844:class_export_destroy()) destroying export ffff9a8047484000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:0.0:1788836556.665912:0:20966:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:0.0:1788836556.665961:0:20966:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a804602d800 1 00000020:00000080:0.0:1788836556.665965:0:20966:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c737571580e 00000020:00000080:0.0:1788836556.665970:0:20966:0:(genops.c:885:class_export_put()) final put ffff9a815f7aa000/lustre-MDT0001-osd_UUID 00000020:01000000:0.0:1788836556.665982:0:20966:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1788836556.665986:0:20966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788836556.665990:0:20966:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788836556.665994:0:20966:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9a816be34d28) has no exports 00000020:00000080:1.0:1788836556.666946:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a815f7aa000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788836556.694440:0:20966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788836556.694455:0:20966:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1788836556.694732:0:20966:0:(genops.c:885:class_export_put()) final put ffff9a804602c000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788836556.694737:0:20966:0:(genops.c:844:class_export_destroy()) destroying export ffff9a804602c000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1788836556.694749:0:20966:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1788836556.694872:0:20966:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a8046028000 00000020:01000000:0.0:1788836556.694894:0:20966:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788836556.694898:0:20966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788836556.694903:0:20966:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788836556.694907:0:20966:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9a817f4db370) has no exports 00000100:00100000:3.0:1788836556.695136:0:17179:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9a804148ac00:17179] 2 exiting: rc = 0 00000100:00100000:1.0:1788836556.695271:0:17176:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9a8159704200:17176] 0 exiting: rc = 1 00000100:00100000:2.0:1788836556.695376:0:19980:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9a816c1d5a00:19980] 3 exiting: rc = 0 00000100:00100000:2.0:1788836556.695524:0:17178:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9a8181a9a000:17178] 1 exiting: rc = 0 00000100:00100000:0.0:1788836556.695813:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.695820:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.695827:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.695833:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.695838:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.695843:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.695849:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.695855:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.695868:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.695874:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.695880:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.695885:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.695891:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.695896:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.695902:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.695908:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.695914:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.695920:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.695926:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.695931:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.695937:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.695942:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.695947:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.695953:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.695958:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.695964:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.695970:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.695976:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.695981:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.695986:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.695991:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.695997:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.696002:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.696008:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.696013:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.696019:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.696025:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.696030:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.696037:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.696042:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.696048:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.696053:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.696059:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.696072:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.696077:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.696083:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.696088:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.696093:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.696099:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.696105:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.696111:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.696116:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.696121:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.696127:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.696142:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.696149:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.696155:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.696160:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.696165:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.696170:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.696176:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.696181:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.696188:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.696194:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836556.700008:0:17181:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9a816d290600:17181] 1 exiting: rc = 0 00000100:00100000:1.0:1788836556.700178:0:17180:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9a816d290200:17180] 0 exiting: rc = 1 00000100:00100000:0.0:1788836556.700290:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700299:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700305:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700311:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700316:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700323:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700327:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700333:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700338:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700343:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700348:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700353:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700357:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700362:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700383:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700388:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700393:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700398:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700403:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700409:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700414:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700419:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700423:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700427:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700432:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700437:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700442:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700447:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700452:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700456:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700641:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700655:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700660:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700666:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700672:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700676:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700681:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700687:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700692:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700698:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700703:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700708:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700713:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700718:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700724:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700729:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700734:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700740:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700746:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700759:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700765:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700770:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700775:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700780:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700785:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700789:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700795:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700800:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700805:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700810:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700815:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700820:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700825:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.700830:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836556.701385:0:17182:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9a804760a400:17182] 0 exiting: rc = 1 00000100:00100000:2.0:1788836556.701671:0:17183:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9a804760a000:17183] 1 exiting: rc = 0 00000100:00100000:0.0:1788836556.701826:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.701833:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.701839:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.701845:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.701853:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.701860:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.701891:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.701904:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.701974:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.701981:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.701987:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.701996:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.702002:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.702007:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.702012:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.702019:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.702025:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.702030:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.702037:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.702057:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.702073:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.702080:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.702120:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.702129:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.702139:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.702146:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.702153:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.702196:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.702204:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.702210:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.702216:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.702241:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.702290:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.702298:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.702308:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.702316:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.702321:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.702358:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.702365:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.702371:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.702377:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.702383:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.702389:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.702408:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.702414:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.702417:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.702421:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.702426:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.702430:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.702434:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.702441:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.702445:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.702450:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.702454:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.702552:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.702580:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.702586:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.702592:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.702598:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.702666:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.702674:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.702680:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.702685:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.702699:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.709408:0:17185:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9a80464baa00:17185] 1 exiting: rc = 0 00000100:00100000:3.0:1788836556.710481:0:17184:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9a804760b800:17184] 0 exiting: rc = 1 00000100:00100000:1.0:1788836556.710549:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.710560:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.710565:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.710570:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.710577:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.710582:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.710588:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.710861:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.710869:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.710874:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.710878:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.710881:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.710885:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.710888:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.710891:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.710894:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.710898:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.710901:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.710904:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.710907:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.710910:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.710913:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.710916:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.710919:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.710921:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.710924:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.710927:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.710931:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.710934:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.710936:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.710939:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.710943:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.710945:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.710958:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.710961:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.710965:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.710968:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.710972:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.710976:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.710979:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.710983:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.710986:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.710989:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.710992:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.710994:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.710997:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.711000:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.711004:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.711007:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.711010:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.711014:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.711017:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.711020:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.711023:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.711026:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.711030:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.711042:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.711046:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.711049:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.711052:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.711055:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.711058:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.711062:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.711065:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836556.711395:0:17187:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9a80464ba600:17187] 1 exiting: rc = 0 00000100:00100000:0.0:1788836556.711516:0:17186:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9a80464bb800:17186] 0 exiting: rc = 1 00000100:00100000:1.0:1788836556.711545:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.711552:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.711557:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.711562:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.711576:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.711581:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.711586:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.711591:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.711597:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.711997:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712007:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712012:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712016:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712022:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712027:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712042:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712050:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712055:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712060:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712064:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712067:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712071:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712074:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712078:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712080:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712084:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712087:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712089:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712092:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712095:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712098:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712101:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712104:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712107:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712110:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712113:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712115:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712118:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712121:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712130:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712133:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712136:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712139:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712142:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712145:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712148:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712151:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712154:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712157:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712160:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712163:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712166:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712169:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712172:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712175:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712178:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712181:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712183:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712186:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712189:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712191:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712195:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712198:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712201:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836556.712519:0:17189:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9a81510b1e00:17189] 1 exiting: rc = 0 00000100:00100000:2.0:1788836556.712740:0:17188:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9a80464bae00:17188] 0 exiting: rc = 1 00000100:00100000:1.0:1788836556.712812:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712816:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712820:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712823:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712826:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712829:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712832:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712835:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712838:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712841:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712850:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712853:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712856:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712860:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712863:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712867:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712870:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712873:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712876:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712879:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712882:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712884:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712887:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712890:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712892:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712895:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712899:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712902:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712905:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712908:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712911:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712914:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712917:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712920:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712923:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712925:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712929:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712932:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712934:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712937:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712940:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712942:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712945:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712947:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712950:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712958:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712961:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712964:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712967:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712969:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712972:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712975:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712977:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712980:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712983:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712986:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712989:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712992:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712995:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.712998:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.713001:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.713004:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.713007:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.713010:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788836556.713449:0:17190:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9a81510b0600:17190] 0 exiting: rc = 1 00000100:00100000:2.0:1788836556.713711:0:17191:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9a81510b0a00:17191] 1 exiting: rc = 0 00000100:00100000:3.0:1788836556.713914:0:17192:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9a8154040c00:17192] 2 exiting: rc = 0 00000100:00100000:1.0:1788836556.714002:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714010:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714016:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714021:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714026:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714031:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714037:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714043:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714049:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714072:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714078:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714085:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714090:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714095:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714101:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714106:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714119:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714123:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714127:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714130:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714134:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714138:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714141:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714145:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714149:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714154:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714158:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714162:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714165:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714169:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714172:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714177:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714181:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714193:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714198:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714201:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714205:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714209:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714213:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714216:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714219:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714223:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714227:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714230:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714234:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714237:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714240:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714244:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714247:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714251:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714265:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714274:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714277:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714280:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714284:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714288:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714291:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714295:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714299:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714302:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714306:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714309:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714312:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836556.714315:0:20966:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788836556.718978:0:20966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788836556.718995:0:20966:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1788836556.719001:0:20966:0:(genops.c:885:class_export_put()) final put ffff9a804765a000/MDS_uuid 00000020:00000080:1.0:1788836556.719005:0:20966:0:(genops.c:844:class_export_destroy()) destroying export ffff9a804765a000/MDS_uuid for MDS 00000020:01000000:1.0:1788836556.719013:0:20966:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1788836556.719162:0:20966:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:1.0:1788836557.354986:0:19380:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836558.393693:0:17166:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788836558.693587:0:16590:0:(pinger.c:229:ptlrpc_pinger_process_import()) 334968c0-1019-487d-94b4-b0d9e3b864ad->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788836558.693600:0:16590:0:(pinger.c:247:ptlrpc_pinger_process_import()) 334968c0-1019-487d-94b4-b0d9e3b864ad->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788836558.693604:0:16590:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788836558.693608:0:16590:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788836558.693613:0:16590:0:(import.c:65:import_set_state_nolock()) ffff9a8046065000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788836558.693623:0:16590:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 583 00000100:00080000:1.0:1788836558.693641:0:16590:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788836558.693651:0:16590:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a8046065000 using connection 192.168.201.144@tcp/0@lo 00000100:00100000:1.0:1788836558.693711:0:16590:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8172d97480 x1875730518754816/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788836558.693792:0:16590:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788836558.693796:0:16590:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788836558.693798:0:16590:0:(import.c:65:import_set_state_nolock()) ffff9a8045632000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788836558.693984:0:16590:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 583 00000100:00080000:1.0:1788836558.693987:0:16590:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788836558.693991:0:16590:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a8045632000 using connection 192.168.201.144@tcp/0@lo 00000100:00100000:1.0:1788836558.694006:0:16590:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8172d95c00 x1875730518755072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788836558.694053:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875730518754944:0@lo:400:kworker.0 00000400:00000100:1.0:1788836558.694123:0:3620:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875730518754944 offset 0 length 224: 4 00000100:00100000:1.0:1788836558.694169:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788836558.694174:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875730518755200:0@lo:400:kworker.0 00000400:00000100:1.0:1788836558.694190:0:3620:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875730518755200 offset 0 length 224: 4 00000100:00100000:3.0:1788836558.694333:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3617:1875730518754816:0@lo:38:kworker.0 00000400:00000100:3.0:1788836558.694362:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875730518754816 offset 0 length 520: 4 00000100:00100000:3.0:1788836558.694377:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3617:1875730518755072:0@lo:38:kworker.0 00000400:00000100:3.0:1788836558.694500:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875730518755072 offset 0 length 520: 4 00010000:00010000:2.0:1788836559.397711:0:19379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836560.422281:0:17165:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788836560.812131:0:21167:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788836560.835680:0:21167:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788836560.835753:0:21167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a80462e7a00/0xbd163c7375715981 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375715988 expref: -99 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836560.835771:0:21167:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a80462e7a00/0xbd163c7375715981 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd163c7375715988 expref: -99 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836560.835802:0:21167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a80462e7a00/0xbd163c7375715981 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd163c7375715988 expref: -99 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836560.835809:0:21167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.144@tcp lock: ffff9a80462e7a00/0xbd163c7375715981 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd163c7375715988 expref: -99 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836560.835837:0:21167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788836560.835844:0:21167:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788836560.835875:0:21167:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788836560.835888:0:21167:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a8172d97480 x1875730518754816/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788836573 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836560.835905:0:21167:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788836560.835911:0:21167:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788836560.835917:0:21167:0:(import.c:65:import_set_state_nolock()) ffff9a8046065000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788836560.835923:0:21167:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788836560.835926:0:21167:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a8172d97480 x1875730518754816/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788836573 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836560.835933:0:21167:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788836560.835936:0:21167:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00010000:00010000:1.0:1788836560.836053:0:19380:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836560.836061:0:19380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.144@tcp lock: ffff9a80462e7a00/0xbd163c7375715981 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd163c7375715988 expref: -99 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836560.836071:0:19380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a80462e7a00 already unused, calling callback (ffffffffc139ec20) 10000000:00010000:1.0:1788836560.836075:0:19380:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.144@tcp lock: ffff9a80462e7a00/0xbd163c7375715981 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd163c7375715988 expref: -99 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836560.836083:0:19380:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.144@tcp lock: ffff9a80462e7a00/0xbd163c7375715981 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xbd163c7375715988 expref: -99 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788836560.836090:0:19380:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.144@tcp lock: ffff9a80462e7a00/0xbd163c7375715981 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xbd163c7375715988 expref: -99 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836560.836104:0:19380:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788836560.836107:0:19380:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788836560.836109:0:19380:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788836560.836124:0:19380:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a8047df4800 00010000:00010000:1.0:1788836560.836128:0:19380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.144@tcp lock: ffff9a80462e7a00/0xbd163c7375715981 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xbd163c7375715988 expref: -99 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836560.836134:0:19380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.144@tcp lock: ffff9a80462e7a00/0xbd163c7375715981 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xbd163c7375715988 expref: -99 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836560.836148:0:19380:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836560.836149:0:19380:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836560.836151:0:19380:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836560.836933:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3617:1875730518754816:0@lo:38:kworker.0 00000100:00080000:1.0:1788836560.839715:0:21167:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788836560.839734:0:21167:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a8172d94e00 x1875730518754944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836574 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836560.839760:0:21167:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788836560.839765:0:21167:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788836560.839787:0:21167:0:(import.c:65:import_set_state_nolock()) ffff9a804841a000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788836560.839888:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3617:1875730518755328:0@lo:39:umount.0 00000400:00000100:0.0:1788836560.839941:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875730518755328 offset 0 length 224: 4 00000100:00100000:3.0:1788836560.840262:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875730518754944:0@lo:400:kworker.0 00010000:00010000:1.0:1788836561.445756:0:17166:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788836561.701949:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 334968c0-1019-487d-94b4-b0d9e3b864ad->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788836561.701960:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 334968c0-1019-487d-94b4-b0d9e3b864ad->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788836561.701963:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788836561.701967:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788836561.702108:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875730518755456:0@lo:400:kworker.0 00000400:00000100:3.0:1788836561.702164:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875730518755456 offset 0 length 224: 4 00000001:00100000:3.0:1788836561.766898:0:18691:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788836561.766906:0:18691:0:(genops.c:885:class_export_put()) final put ffff9a804841f800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788836561.767240:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a804841f800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788836561.767299:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a804841d800 for lustre-OST0000 00000001:00100000:3.0:1788836561.767616:0:19511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788836561.767621:0:19511:0:(genops.c:885:class_export_put()) final put ffff9a8046221800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788836561.767688:0:16590:0:(genops.c:844:class_export_destroy()) destroying export ffff9a8046221800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788836561.767723:0:16590:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a8046220800 for lustre-OST0001 00010000:00010000:2.0:1788836562.470775:0:19379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836563.493885:0:17165:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788836563.749623:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 334968c0-1019-487d-94b4-b0d9e3b864ad->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788836563.749634:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 334968c0-1019-487d-94b4-b0d9e3b864ad->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788836563.749638:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788836563.749642:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788836563.749846:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875730518755584:0@lo:400:kworker.0 00000400:00000100:0.0:1788836563.749904:0:3619:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875730518755584 offset 0 length 224: 4 00010000:00010000:1.0:1788836564.520509:0:19380:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836565.543352:0:17166:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836566.565639:0:19379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836567.013635:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788836556/real 1788836556] req@ffff9a8172d95500 x1875730518754688/t0(0) o250->MGC192.168.201.144@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788836566 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836567.013673:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a8172d95500 x1875730518754688/t0(0) o250->MGC192.168.201.144@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788836566 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788836567.013698:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9a8047df4800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788836567.013732:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788836567.013737:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:334968c0-1019-487d-94b4-b0d9e3b864ad:3617:1875730518754688:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:2.0:1788836567.014069:0:16590:0:(pinger.c:229:ptlrpc_pinger_process_import()) 334968c0-1019-487d-94b4-b0d9e3b864ad->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788836567.014087:0:16590:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788836567.014091:0:16590:0:(import.c:65:import_set_state_nolock()) ffff9a8047df4800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788836567.014096:0:16590:0:(import.c:510:import_select_connection()) MGC192.168.201.144@tcp: connect to NID 0@lo last attempt 586 00000100:00080000:2.0:1788836567.014124:0:16590:0:(import.c:589:import_select_connection()) MGC192.168.201.144@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788836567.014132:0:16590:0:(import.c:624:import_select_connection()) MGC192.168.201.144@tcp: import ffff9a8047df4800 using connection 192.168.201.144@tcp/0@lo 00000100:00100000:2.0:1788836567.014199:0:16590:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a817f534a80 x1875730518755712/t0(0) o250->MGC192.168.201.144@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788836567.014232:0:16590:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788836567.014236:0:16590:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788836567.014360:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f537100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875730518755840:0@lo:400:kworker.0 00000400:00000100:1.0:1788836567.014427:0:3620:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875730518755840 offset 0 length 224: 4 00000100:00100000:3.0:1788836567.016007:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f534a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:334968c0-1019-487d-94b4-b0d9e3b864ad:3617:1875730518755712:0@lo:250:kworker.0 00000400:00000100:3.0:1788836567.016069:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875730518755712 offset 0 length 520: 4 00010000:00010000:1.0:1788836567.590106:0:17165:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836568.614505:0:19380:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836569.638667:0:17166:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836570.085871:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788836560/real 1788836560] req@ffff9a8172d96d80 x1875730518755328/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788836570 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836570.085912:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a8172d96d80 x1875730518755328/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788836570 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788836570.085927:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9a804841a000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788836570.085947:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3617:1875730518755328:0@lo:39:umount.0 00000100:00080000:1.0:1788836570.086395:0:21167:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788836570.086400:0:21167:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788836570.086406:0:21167:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788836570.087387:0:21167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a815158ec00/0xbd163c7375715957 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c737571595e expref: -99 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836570.087404:0:21167:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a815158ec00/0xbd163c7375715957 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd163c737571595e expref: -99 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836570.087412:0:21167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a815158ec00/0xbd163c7375715957 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd163c737571595e expref: -99 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836570.087419:0:21167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.144@tcp lock: ffff9a815158ec00/0xbd163c7375715957 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd163c737571595e expref: -99 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836570.087489:0:21167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788836570.087513:0:21167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a8167974a00/0xbd163c7375715cad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375715cb4 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836570.087520:0:21167:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a8167974a00/0xbd163c7375715cad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd163c7375715cb4 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836570.087525:0:21167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a8167974a00/0xbd163c7375715cad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd163c7375715cb4 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836570.087530:0:21167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.144@tcp lock: ffff9a8167974a00/0xbd163c7375715cad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd163c7375715cb4 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836570.087555:0:21167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788836570.087560:0:21167:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1788836570.087585:0:21167:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1788836570.087590:0:21167:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1788836570.087595:0:21167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788836570.087600:0:21167:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788836570.087603:0:21167:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9a817f3f8000) has no exports 00000020:00080000:1.0:1788836570.087628:0:21167:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9a817f3f8000) has no exports 00000020:01000000:1.0:1788836570.089264:0:21167:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a8142ab9c60 - data ffff9a815d68e948/ffff9a8166ddac00 00010000:00010000:2.0:1788836570.089562:0:19379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788836570.089571:0:19379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.144@tcp lock: ffff9a815158ec00/0xbd163c7375715957 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd163c737571595e expref: -99 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836570.089583:0:19379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a815158ec00 already unused, calling callback (ffffffffc139ec20) 10000000:00010000:2.0:1788836570.089587:0:19379:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.144@tcp lock: ffff9a815158ec00/0xbd163c7375715957 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd163c737571595e expref: -99 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836570.089597:0:19379:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.144@tcp lock: ffff9a815158ec00/0xbd163c7375715957 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xbd163c737571595e expref: -99 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788836570.089614:0:19379:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.144@tcp lock: ffff9a815158ec00/0xbd163c7375715957 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xbd163c737571595e expref: -99 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836570.089620:0:19379:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788836570.089622:0:19379:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1788836570.089625:0:19379:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1788836570.089641:0:19379:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a8047df4800 00010000:00010000:2.0:1788836570.089644:0:19379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.144@tcp lock: ffff9a815158ec00/0xbd163c7375715957 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xbd163c737571595e expref: -99 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836570.089651:0:19379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.144@tcp lock: ffff9a815158ec00/0xbd163c7375715957 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xbd163c737571595e expref: -99 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836570.089681:0:19379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836570.089685:0:19379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.144@tcp lock: ffff9a8167974a00/0xbd163c7375715cad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd163c7375715cb4 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836570.089690:0:19379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8167974a00 already unused, calling callback (ffffffffc139ec20) 10000000:00010000:2.0:1788836570.089693:0:19379:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.144@tcp lock: ffff9a8167974a00/0xbd163c7375715cad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd163c7375715cb4 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836570.089700:0:19379:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.144@tcp lock: ffff9a8167974a00/0xbd163c7375715cad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xbd163c7375715cb4 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788836570.089706:0:19379:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.144@tcp lock: ffff9a8167974a00/0xbd163c7375715cad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xbd163c7375715cb4 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836570.089711:0:19379:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788836570.089713:0:19379:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788836570.089716:0:19379:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788836570.089722:0:19379:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a8047df4800 00010000:00010000:2.0:1788836570.089726:0:19379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.144@tcp lock: ffff9a8167974a00/0xbd163c7375715cad lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xbd163c7375715cb4 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836570.089732:0:19379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.144@tcp lock: ffff9a8167974a00/0xbd163c7375715cad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xbd163c7375715cb4 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836570.089740:0:19379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836570.089742:0:19379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836570.089744:0:19379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836570.090356:0:17165:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788836570.097081:0:21167:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a80456d1de0 - data ffff9a81493b1e58/ffff9a8046305000 00100000:10000000:1.0:1788836570.122506:0:21167:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788836570.135344:0:21167:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c737571596c 00000020:00000080:0.0:1788836570.135360:0:21167:0:(genops.c:885:class_export_put()) final put ffff9a815f7a8800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788836570.135392:0:21167:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a816c20e800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788836570.135396:0:21167:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a816c20e800 2 00000020:01000004:0.0:1788836570.135400:0:21167:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a816c20e800 from lustre-OST0000 00000020:00000080:0.0:1788836570.135425:0:21167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788836570.135449:0:21167:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788836570.135453:0:21167:0:(genops.c:885:class_export_put()) final put ffff9a8046222000/lustre-OST0000_UUID 00000020:00000080:0.0:1788836570.135488:0:21167:0:(genops.c:844:class_export_destroy()) destroying export ffff9a8046222000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788836570.135496:0:21167:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1788836570.135547:0:21167:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1788836570.135552:0:21167:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788836570.135555:0:21167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788836570.135561:0:21167:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788836570.135567:0:21167:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9a804841c000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788836570.135574:0:21167:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff9a816c10b370) has exports, disconnecting them 00000020:00080000:0.0:1788836570.135580:0:21167:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9a804841c000), last request at 1788836479 00000020:00000080:0.0:1788836570.135584:0:21167:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c7375715996 00000020:00080000:0.0:1788836570.135595:0:21167:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a804841c000): rc 0 00000020:00000080:0.0:1788836570.135600:0:21167:0:(genops.c:885:class_export_put()) final put ffff9a804841c000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788836570.136287:0:16590:0:(genops.c:844:class_export_destroy()) destroying export ffff9a815f7a8800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788836570.136305:0:16590:0:(genops.c:844:class_export_destroy()) destroying export ffff9a804841c000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1788836570.140382:0:21167:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788836570.140393:0:21167:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788836570.140397:0:21167:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788836570.140422:0:21167:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788836570.140456:0:16590:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a8046065000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788836570.140673:0:21167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788836570.140682:0:21167:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788836570.140687:0:21167:0:(genops.c:885:class_export_put()) final put ffff9a8046062800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788836570.140692:0:21167:0:(genops.c:844:class_export_destroy()) destroying export ffff9a8046062800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788836570.140698:0:21167:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1788836570.140767:0:21167:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788836570.140771:0:21167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788836570.140776:0:21167:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788836570.140783:0:21167:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9a804841a800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788836570.140788:0:21167:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff9a816c108000) has exports, disconnecting them 00000020:00080000:3.0:1788836570.140793:0:21167:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9a804841a800), last request at 1788836479 00000020:00000080:3.0:1788836570.140797:0:21167:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c73757159ab 00000020:00080000:3.0:1788836570.140809:0:21167:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a804841a800): rc 0 00000020:00000080:3.0:1788836570.140814:0:21167:0:(genops.c:885:class_export_put()) final put ffff9a804841a800/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788836570.140843:0:16590:0:(genops.c:844:class_export_destroy()) destroying export ffff9a804841a800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:2.0:1788836570.145076:0:21167:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788836570.145086:0:21167:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788836570.145106:0:21167:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788836570.145114:0:21167:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788836570.145340:0:21167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788836570.145350:0:21167:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:2.0:1788836570.145357:0:21167:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a816c20e800 1 00000020:00000080:2.0:1788836570.145365:0:21167:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c7375715949 00000020:00000080:2.0:1788836570.145386:0:21167:0:(genops.c:885:class_export_put()) final put ffff9a8146099000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1788836570.145392:0:21167:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788836570.145397:0:21167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788836570.145401:0:21167:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788836570.145405:0:21167:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff9a817f3fcd28) has no exports 00000020:00000080:3.0:1788836570.148703:0:16590:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a804841a000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788836570.148723:0:16590:0:(genops.c:885:class_export_put()) final put ffff9a8048419000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1788836570.148727:0:16590:0:(genops.c:844:class_export_destroy()) destroying export ffff9a8048419000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1788836570.148735:0:16590:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1788836570.148811:0:16590:0:(genops.c:844:class_export_destroy()) destroying export ffff9a8146099000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788836570.235260:0:21167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788836570.235275:0:21167:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1788836570.235281:0:21167:0:(genops.c:885:class_export_put()) final put ffff9a816c209000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1788836570.235285:0:21167:0:(genops.c:844:class_export_destroy()) destroying export ffff9a816c209000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1788836570.235295:0:21167:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1788836570.235888:0:21167:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a816c20c800 00000020:02000400:2.0:1788836570.235950:0:21167:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1788836570.669451:0:19380:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836571.689717:0:17166:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788836572.519536:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 334968c0-1019-487d-94b4-b0d9e3b864ad->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788836572.519549:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 334968c0-1019-487d-94b4-b0d9e3b864ad->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788836572.519552:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788836572.519555:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788836572.519776:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f536680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1875730518755968:0@lo:400:kworker.0 00000400:00000100:1.0:1788836572.519834:0:3621:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875730518755968 offset 0 length 224: 4 00010000:00010000:2.0:1788836572.710606:0:19379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836573.158102:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788836558/real 1788836558] req@ffff9a8172d95c00 x1875730518755072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788836573 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836573.158145:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a8172d95c00 x1875730518755072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788836573 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788836573.160049:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9a8045632000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788836573.160090:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788836573.160097:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3617:1875730518755072:0@lo:38:kworker.0 00000100:00080000:3.0:1788836573.165919:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 334968c0-1019-487d-94b4-b0d9e3b864ad->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788836573.165930:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 334968c0-1019-487d-94b4-b0d9e3b864ad->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788836573.165933:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788836573.165938:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788836573.165962:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a8045632000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788836573.165983:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 588 00000100:00080000:3.0:1788836573.165989:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788836573.166002:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a8045632000 using connection 192.168.201.144@tcp/0@lo 00000100:00100000:3.0:1788836573.166044:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a81412eb100 x1875730518756096/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788836573.168533:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a81412ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875730518756224:0@lo:400:kworker.0 00000400:00000100:2.0:1788836573.168593:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875730518756224 offset 0 length 224: 4 00000100:00100000:0.0:1788836573.169259:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a81412eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3617:1875730518756096:0@lo:38:kworker.0 00000400:00000100:0.0:1788836573.169305:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875730518756096 offset 0 length 520: 4 00010000:00010000:0.0:1788836573.737112:0:17165:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1788836574.181729:0:3620:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788836558/real 1788836558] req@ffff9a8172d97800 x1875730518755200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788836574 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836574.223825:0:3620:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9a8172d97800 x1875730518755200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788836574 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788836574.223840:0:3620:0:(import.c:65:import_set_state_nolock()) ffff9a8045635000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788836574.223844:0:3620:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788836574.255065:0:3620:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00100000:1.0:1788836574.270699:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875730518755200:0@lo:400:kworker.0 00000100:00080000:2.0:1788836574.272441:0:16590:0:(pinger.c:229:ptlrpc_pinger_process_import()) 334968c0-1019-487d-94b4-b0d9e3b864ad->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788836574.272453:0:16590:0:(pinger.c:247:ptlrpc_pinger_process_import()) 334968c0-1019-487d-94b4-b0d9e3b864ad->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788836574.272455:0:16590:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788836574.272490:0:16590:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788836574.272492:0:16590:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788836574.272508:0:16590:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788836574.272513:0:16590:0:(import.c:65:import_set_state_nolock()) ffff9a8045635000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788836574.272522:0:16590:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 527 00000100:00080000:2.0:1788836574.272533:0:16590:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9a8045635000 using connection 192.168.201.144@tcp/0@lo 00000100:00100000:2.0:1788836574.272576:0:16590:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a817f537800 x1875730518756352/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788836574.272838:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f537800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3617:1875730518756352:0@lo:38:kworker.0 00000400:00000100:1.0:1788836574.272896:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875730518756352 offset 0 length 520: 4 00010000:00010000:1.0:1788836574.757584:0:19380:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788836574.908817:0:21370:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788836574.924553:0:21370:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788836574.924644:0:21370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a817f41b200/0xbd163c7375715adf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375715ae6 expref: -99 pid: 19510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836574.924659:0:21370:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a817f41b200/0xbd163c7375715adf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd163c7375715ae6 expref: -99 pid: 19510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836574.924666:0:21370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a817f41b200/0xbd163c7375715adf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd163c7375715ae6 expref: -99 pid: 19510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836574.924674:0:21370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.144@tcp lock: ffff9a817f41b200/0xbd163c7375715adf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd163c7375715ae6 expref: -99 pid: 19510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836574.924697:0:21370:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788836574.924703:0:21370:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788836574.924728:0:21370:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788836574.924741:0:21370:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a81412eb100 x1875730518756096/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788836593 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836574.924763:0:21370:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788836574.924771:0:21370:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788836574.924778:0:21370:0:(import.c:65:import_set_state_nolock()) ffff9a8045632000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788836574.924784:0:21370:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788836574.924803:0:21370:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a81412eb100 x1875730518756096/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788836593 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836574.924811:0:21370:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788836574.924814:0:21370:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00010000:00010000:1.0:1788836574.926337:0:17166:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836574.926349:0:17166:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.144@tcp lock: ffff9a817f41b200/0xbd163c7375715adf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd163c7375715ae6 expref: -99 pid: 19510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836574.926361:0:17166:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a817f41b200 already unused, calling callback (ffffffffc139ec20) 10000000:00010000:1.0:1788836574.926365:0:17166:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.144@tcp lock: ffff9a817f41b200/0xbd163c7375715adf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd163c7375715ae6 expref: -99 pid: 19510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836574.926375:0:17166:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.144@tcp lock: ffff9a817f41b200/0xbd163c7375715adf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xbd163c7375715ae6 expref: -99 pid: 19510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788836574.926446:0:17166:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.144@tcp lock: ffff9a817f41b200/0xbd163c7375715adf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xbd163c7375715ae6 expref: -99 pid: 19510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836574.926452:0:17166:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788836574.926455:0:17166:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788836574.926487:0:17166:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788836574.926505:0:17166:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a8047df4800 00010000:00010000:1.0:1788836574.926509:0:17166:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.144@tcp lock: ffff9a817f41b200/0xbd163c7375715adf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xbd163c7375715ae6 expref: -99 pid: 19510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836574.926517:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.144@tcp lock: ffff9a817f41b200/0xbd163c7375715adf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xbd163c7375715ae6 expref: -99 pid: 19510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836574.926531:0:17166:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836574.926533:0:17166:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836574.926534:0:17166:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836574.926621:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a81412eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3617:1875730518756096:0@lo:38:kworker.0 00000100:00080000:1.0:1788836574.930002:0:21370:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788836574.930023:0:21370:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a8172d94a80 x1875730518755456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836577 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836574.930041:0:21370:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a8172d94e00 x1875730518755584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836579 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836574.930061:0:21370:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a817f537100 x1875730518755840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836583 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836574.930083:0:21370:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a817f536680 x1875730518755968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836588 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836574.930101:0:21370:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a81412ea680 x1875730518756224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836589 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836574.930110:0:21370:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a817f537800 x1875730518756352/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788836584 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836574.930122:0:21370:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:1.0:1788836574.930158:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f536680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1875730518755968:0@lo:400:kworker.0 00000100:00080000:1.0:1788836574.930189:0:21370:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788836574.930195:0:21370:0:(import.c:65:import_set_state_nolock()) ffff9a8045635000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1788836574.930213:0:21370:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788836574.930218:0:21370:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a8172d94a80 x1875730518755456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836577 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836574.930226:0:21370:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a8172d94e00 x1875730518755584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836579 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836574.930234:0:21370:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a817f537100 x1875730518755840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836583 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836574.930241:0:21370:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a81412ea680 x1875730518756224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836589 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836574.930249:0:21370:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a817f537800 x1875730518756352/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788836584 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836574.930254:0:21370:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788836574.930257:0:21370:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:3.0:1788836574.930490:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f537100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875730518755840:0@lo:400:kworker.0 00000100:00100000:2.0:1788836574.931076:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a81412ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875730518756224:0@lo:400:kworker.0 00000100:00100000:2.0:1788836574.931086:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875730518755456:0@lo:400:kworker.0 00000100:00100000:0.0:1788836574.931193:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875730518755584:0@lo:400:kworker.0 00000100:00100000:0.0:1788836574.931233:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f537800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3617:1875730518756352:0@lo:38:kworker.0 00010000:00010000:1.0:1788836574.932533:0:21370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a814659ce00/0xbd163c7375715ab5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375715abc expref: -99 pid: 19510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836574.932551:0:21370:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a814659ce00/0xbd163c7375715ab5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd163c7375715abc expref: -99 pid: 19510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836574.932559:0:21370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a814659ce00/0xbd163c7375715ab5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd163c7375715abc expref: -99 pid: 19510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836574.932566:0:21370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.144@tcp lock: ffff9a814659ce00/0xbd163c7375715ab5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd163c7375715abc expref: -99 pid: 19510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836574.932593:0:21370:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788836574.932600:0:21370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a8141497200/0xbd163c7375715c9f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375715ca6 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836574.932622:0:21370:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a8141497200/0xbd163c7375715c9f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd163c7375715ca6 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836574.932628:0:21370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a8141497200/0xbd163c7375715c9f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd163c7375715ca6 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836574.932634:0:21370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.144@tcp lock: ffff9a8141497200/0xbd163c7375715c9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbd163c7375715ca6 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836574.932649:0:21370:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788836574.932654:0:21370:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1788836574.932681:0:21370:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1788836574.932686:0:21370:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1788836574.932691:0:21370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788836574.932697:0:21370:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788836574.932701:0:21370:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9a815f604d28) has no exports 00000020:00080000:1.0:1788836574.932725:0:21370:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9a815f604d28) has no exports 00010000:00010000:0.0:1788836574.934713:0:17165:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788836574.934726:0:17165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.144@tcp lock: ffff9a814659ce00/0xbd163c7375715ab5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd163c7375715abc expref: -99 pid: 19510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836574.934739:0:17165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a814659ce00 already unused, calling callback (ffffffffc139ec20) 10000000:00010000:0.0:1788836574.934743:0:17165:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.144@tcp lock: ffff9a814659ce00/0xbd163c7375715ab5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd163c7375715abc expref: -99 pid: 19510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836574.934754:0:17165:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.144@tcp lock: ffff9a814659ce00/0xbd163c7375715ab5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xbd163c7375715abc expref: -99 pid: 19510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788836574.934761:0:17165:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.144@tcp lock: ffff9a814659ce00/0xbd163c7375715ab5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xbd163c7375715abc expref: -99 pid: 19510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836574.934767:0:17165:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788836574.934769:0:17165:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1788836574.934772:0:17165:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1788836574.934789:0:17165:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a8047df4800 00010000:00010000:0.0:1788836574.934793:0:17165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.144@tcp lock: ffff9a814659ce00/0xbd163c7375715ab5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xbd163c7375715abc expref: -99 pid: 19510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836574.934800:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.144@tcp lock: ffff9a814659ce00/0xbd163c7375715ab5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xbd163c7375715abc expref: -99 pid: 19510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836574.934813:0:17165:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836574.934817:0:17165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.144@tcp lock: ffff9a8141497200/0xbd163c7375715c9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd163c7375715ca6 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836574.934841:0:17165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8141497200 already unused, calling callback (ffffffffc139ec20) 10000000:00010000:0.0:1788836574.934844:0:17165:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.144@tcp lock: ffff9a8141497200/0xbd163c7375715c9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbd163c7375715ca6 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836574.934851:0:17165:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.144@tcp lock: ffff9a8141497200/0xbd163c7375715c9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xbd163c7375715ca6 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788836574.934857:0:17165:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.144@tcp lock: ffff9a8141497200/0xbd163c7375715c9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xbd163c7375715ca6 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836574.934862:0:17165:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788836574.934864:0:17165:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788836574.934866:0:17165:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788836574.934872:0:17165:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a8047df4800 00010000:00010000:0.0:1788836574.934875:0:17165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.144@tcp lock: ffff9a8141497200/0xbd163c7375715c9f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xbd163c7375715ca6 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836574.934881:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.144@tcp lock: ffff9a8141497200/0xbd163c7375715c9f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xbd163c7375715ca6 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836574.934897:0:17165:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836574.934900:0:17165:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836574.934902:0:17165:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836574.934994:0:19379:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788836574.937242:0:21370:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a81678ded80 - data ffff9a815d74a360/ffff9a8166dc2c00 00000020:01000000:1.0:1788836574.938660:0:21370:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a81678decc0 - data ffff9a80458c1000/ffff9a8166de6400 00100000:10000000:1.0:1788836574.954087:0:21370:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788836574.958747:0:21370:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c7375715aca 00000020:00000080:0.0:1788836574.958762:0:21370:0:(genops.c:885:class_export_put()) final put ffff9a80472e6000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1788836574.958787:0:21370:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a8046067000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1788836574.958791:0:21370:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8046067000 2 00000020:01000004:0.0:1788836574.958795:0:21370:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a8046067000 from lustre-OST0001 00000020:00000080:0.0:1788836574.958821:0:21370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788836574.958838:0:21370:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1788836574.958842:0:21370:0:(genops.c:885:class_export_put()) final put ffff9a80472e2000/lustre-OST0001_UUID 00000020:00000080:0.0:1788836574.958845:0:21370:0:(genops.c:844:class_export_destroy()) destroying export ffff9a80472e2000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1788836574.958853:0:21370:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1788836574.958974:0:21370:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 334968c0-1019-487d-94b4-b0d9e3b864ad->MGS 00010000:00010000:0.0:1788836574.958989:0:21370:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.144@tcp lock: ffff9a815158f800/0xbd163c7375715815 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xbd163c737571581c expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788836574.959001:0:21370:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.144@tcp lock: ffff9a815158f800/0xbd163c7375715815 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xbd163c737571581c expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836574.959008:0:21370:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1788836574.959010:0:21370:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1788836574.959013:0:21370:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1788836574.959026:0:21370:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a8047df4800 00010000:00010000:0.0:1788836574.959030:0:21370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.144@tcp lock: ffff9a815158f800/0xbd163c7375715815 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xbd163c737571581c expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836574.959042:0:21370:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.144@tcp lock: ffff9a80462e6600/0xbd163c7375715704 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xbd163c737571570b expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788836574.959049:0:21370:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.144@tcp lock: ffff9a80462e6600/0xbd163c7375715704 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xbd163c737571570b expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836574.959053:0:21370:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788836574.959055:0:21370:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1788836574.959056:0:21370:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1788836574.959062:0:21370:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a8047df4800 00010000:00010000:0.0:1788836574.959065:0:21370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.144@tcp lock: ffff9a80462e6600/0xbd163c7375715704 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xbd163c737571570b expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788836574.959077:0:21370:0:(import.c:65:import_set_state_nolock()) ffff9a8047df4800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1788836574.959085:0:21370:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788836574.959087:0:21370:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788836574.959089:0:21370:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788836574.959093:0:21370:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788836574.959104:0:21370:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a817f534a80 x1875730518755712/t0(0) o250->MGC192.168.201.144@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788836582 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788836574.959162:0:21370:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788836574.959165:0:21370:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 10s for inflight to error out 00000020:00000080:2.0:1788836574.959452:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a80472e6000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:3.0:1788836574.961774:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f534a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:334968c0-1019-487d-94b4-b0d9e3b864ad:3617:1875730518755712:0@lo:250:kworker.0 10000000:01000000:0.0:1788836574.961901:0:21370:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788836574.961914:0:21370:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c73757156ef 00000020:00000080:0.0:1788836574.961923:0:21370:0:(genops.c:885:class_export_put()) final put ffff9a804765b800/334968c0-1019-487d-94b4-b0d9e3b864ad 00000020:01000000:0.0:1788836574.961953:0:21370:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.144@tcp (flags='') 00000020:00000080:0.0:1788836574.961961:0:21370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788836574.961969:0:21370:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.144@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788836574.961973:0:21370:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9a817f3f99b8) has no exports 00000020:00000080:2.0:1788836574.962020:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a804765b800/334968c0-1019-487d-94b4-b0d9e3b864ad for MGC192.168.201.144@tcp 10000000:01000000:3.0:1788836574.962063:0:17174:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1788836574.962156:0:21370:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.144@tcp: client import never connected 00000100:00080000:0.0:1788836574.962160:0:21370:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1788836574.962163:0:21370:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788836574.962166:0:21370:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1788836574.962167:0:21370:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788836574.962209:0:21370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788836574.962215:0:21370:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.144@tcp (uuid 334968c0-1019-487d-94b4-b0d9e3b864ad) 00000020:01000000:0.0:1788836574.962223:0:21370:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788836574.962226:0:21370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788836574.962230:0:21370:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788836574.962235:0:21370:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9a8045636800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788836574.962239:0:21370:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff9a81488ecd28) has exports, disconnecting them 00000020:00080000:0.0:1788836574.962243:0:21370:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9a8045636800), last request at 1788836496 00000020:00000080:0.0:1788836574.962247:0:21370:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c7375715af4 00000020:00080000:0.0:1788836574.962257:0:21370:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a8045636800): rc 0 00000020:00000080:0.0:1788836574.962260:0:21370:0:(genops.c:885:class_export_put()) final put ffff9a8045636800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788836574.963009:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a8047df4800 for MGC192.168.201.144@tcp 00000020:00000080:2.0:1788836574.963018:0:37:0:(genops.c:885:class_export_put()) final put ffff9a8047df0000/334968c0-1019-487d-94b4-b0d9e3b864ad 00000020:00000080:2.0:1788836574.963021:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a8047df0000/334968c0-1019-487d-94b4-b0d9e3b864ad for MGC192.168.201.144@tcp 00000020:01000000:2.0:1788836574.963026:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.144@tcp (334968c0-1019-487d-94b4-b0d9e3b864ad) 00000020:00000080:2.0:1788836574.963288:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a8045636800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788836575.003716:0:21370:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788836575.003728:0:21370:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788836575.003733:0:21370:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788836575.003741:0:21370:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788836575.003957:0:21370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788836575.003967:0:21370:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1788836575.003975:0:21370:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788836575.003992:0:21370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788836575.003998:0:21370:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788836575.004006:0:21370:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9a8045634800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788836575.004014:0:21370:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff9a81488eb370) has exports, disconnecting them 00000020:00080000:2.0:1788836575.004019:0:21370:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9a8045634800), last request at 1788836496 00000020:00000080:2.0:1788836575.004024:0:21370:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c7375715b09 00000020:00080000:2.0:1788836575.004042:0:21370:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a8045634800): rc 0 00000020:00000080:2.0:1788836575.004049:0:21370:0:(genops.c:885:class_export_put()) final put ffff9a8045634800/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1788836575.004784:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a8045632000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788836575.004793:0:37:0:(genops.c:885:class_export_put()) final put ffff9a8046063000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788836575.004797:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a8046063000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788836575.004808:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788836575.004866:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a8045634800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1788836575.023120:0:21370:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788836575.023129:0:21370:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788836575.023134:0:21370:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788836575.023143:0:21370:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788836575.023298:0:19380:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1788836575.023631:0:17166:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1788836575.023771:0:17165:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:0.0:1788836575.024194:0:19379:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:0.0:1788836575.024357:0:17161:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9a8167977000:17161] 1 exiting: rc = 0 00000100:00100000:1.0:1788836575.024697:0:17160:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9a8167977a00:17160] 0 exiting: rc = 1 00000020:00000080:3.0:1788836575.024862:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a8045635000 for lustre-MDT0001-lwp-OST0001 00000100:00100000:2.0:1788836575.025035:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.025042:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836575.025444:0:20220:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9a8041479600:20220] 3 exiting: rc = 0 00000100:00100000:2.0:1788836575.025836:0:17164:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9a8167b0c200:17164] 2 exiting: rc = 0 00000100:00100000:0.0:1788836575.026091:0:17162:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9a8178d1f400:17162] 0 exiting: rc = 1 00000100:00100000:0.0:1788836575.026168:0:17163:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9a8167ab7200:17163] 1 exiting: rc = 0 00000100:00100000:2.0:1788836575.026267:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026274:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026281:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026287:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026294:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026301:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026306:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026311:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026317:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026322:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026327:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026332:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026339:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026344:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026349:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026354:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026360:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026623:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026629:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026635:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026640:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026645:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026651:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026657:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026662:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026668:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026673:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026678:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026684:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026689:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026695:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026699:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026705:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026711:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026716:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026721:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026726:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026731:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026736:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026741:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026746:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026751:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026756:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026762:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026767:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026772:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026777:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026782:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026787:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026792:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026797:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026802:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026814:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026819:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026824:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026829:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026834:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026839:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026844:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026849:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026853:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026858:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026863:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.026867:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788836575.028778:0:21370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788836575.028793:0:21370:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1788836575.028800:0:21370:0:(genops.c:885:class_export_put()) final put ffff9a8045633000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1788836575.028805:0:21370:0:(genops.c:844:class_export_destroy()) destroying export ffff9a8045633000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1788836575.028810:0:21370:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1788836575.028865:0:21370:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8046067000 1 00000020:00000080:2.0:1788836575.028871:0:21370:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbd163c7375715aae 00000020:00000080:2.0:1788836575.028877:0:21370:0:(genops.c:885:class_export_put()) final put ffff9a8046312000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1788836575.028900:0:21370:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1788836575.028905:0:21370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788836575.028909:0:21370:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788836575.028913:0:21370:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff9a816c1099b8) has no exports 00000020:00000080:0.0:1788836575.029521:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a8046312000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788836575.074575:0:21370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788836575.074668:0:21370:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1788836575.074676:0:21370:0:(genops.c:885:class_export_put()) final put ffff9a8046063800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1788836575.074682:0:21370:0:(genops.c:844:class_export_destroy()) destroying export ffff9a8046063800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788836575.074696:0:21370:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1788836575.075100:0:21370:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a8046066000 00000020:01000000:2.0:1788836575.075131:0:21370:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1788836575.075137:0:21370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788836575.075501:0:21370:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788836575.075518:0:21370:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9a8167beb370) has no exports 00000020:00000080:2.0:1788836575.075544:0:21370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788836575.075551:0:21370:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788836575.075555:0:21370:0:(genops.c:885:class_export_put()) final put ffff9a8146099800/OSS_uuid 00000020:00000080:2.0:1788836575.075557:0:21370:0:(genops.c:844:class_export_destroy()) destroying export ffff9a8146099800/OSS_uuid for OSS 00000020:01000000:2.0:1788836575.075562:0:21370:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1788836575.075807:0:18697:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9a816d2bb200:18697] 2 exiting: rc = 0 00000100:00100000:1.0:1788836575.075908:0:19082:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9a80462e4400:19082] 3 exiting: rc = 0 00000100:00100000:2.0:1788836575.076562:0:18696:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9a816be8b600:18696] 1 exiting: rc = 0 00000100:00100000:2.0:1788836575.078623:0:18695:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9a804735ea00:18695] 0 exiting: rc = 1 00000100:00100000:1.0:1788836575.078818:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.078826:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.078832:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.078837:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.078842:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.078848:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.078868:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.078874:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.078879:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.078884:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.078889:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.078895:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.078901:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.078906:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.078910:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.078915:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.078920:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.078925:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.078931:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.078936:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.078955:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.078960:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.078964:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.078969:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.078974:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.078979:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.078983:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.078987:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.078992:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.078996:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.079001:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.079006:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.079010:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.079014:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.079019:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.079024:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.079029:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.079034:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.079049:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.079055:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.079060:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.079070:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.079075:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.079084:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.079091:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.079100:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.079106:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.079110:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.079115:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.079119:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.079124:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.079129:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.079134:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.079139:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.079158:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.079162:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.079168:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.079173:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.079178:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.079183:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.079190:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.079195:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.079199:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.079204:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.080518:0:18698:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9a816c36ec00:18698] 0 exiting: rc = 1 00000100:00100000:2.0:1788836575.080635:0:18699:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9a816d2ba400:18699] 1 exiting: rc = 0 00000100:00100000:1.0:1788836575.080999:0:20219:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9a816c1dda00:20219] 2 exiting: rc = 0 00000100:00100000:2.0:1788836575.081254:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.081260:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.081265:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.081271:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.081276:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.081281:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.081354:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.081360:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.081364:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.081369:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.081374:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.081379:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.081383:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.081388:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.081393:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.081398:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.081403:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.081408:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.081413:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.081418:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.081422:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.081426:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.081431:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.081436:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.081456:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00080000:3.0:1788836575.081677:0:17173:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1788836575.081988:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.081996:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.082001:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.082006:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.082011:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.082016:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.082020:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.082025:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.082031:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.082036:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.082041:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.082046:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.082051:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.082057:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.082062:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.082066:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.082070:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.082074:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.082079:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.082084:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.082088:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.082093:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.082097:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.082102:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.082107:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.082112:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.082117:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.082121:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.082127:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.082132:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.082137:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.082155:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.082161:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.082166:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.082180:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.082185:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.082189:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.082194:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.082199:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836575.083693:0:18700:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9a8046365400:18700] 0 exiting: rc = 1 00000100:00100000:1.0:1788836575.084277:0:18701:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9a8046364c00:18701] 1 exiting: rc = 0 00000100:00100000:1.0:1788836575.084453:0:20333:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff9a8046574400:20333] 3 exiting: rc = 0 00000100:00100000:1.0:1788836575.084825:0:18702:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9a8046365200:18702] 2 exiting: rc = 0 00000100:00100000:2.0:1788836575.084981:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.084988:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.084995:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085001:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085008:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085014:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085029:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085037:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085045:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085051:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085057:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085063:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085069:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085074:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085080:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085093:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085100:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085107:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085113:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085119:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085125:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085131:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085138:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085205:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085212:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085216:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085221:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085227:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085232:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085237:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085257:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085264:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085269:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085276:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085345:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085355:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085361:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085366:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085371:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085391:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085397:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085403:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085408:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085414:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085419:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085424:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085430:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085436:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085442:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085448:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085454:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085533:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085541:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085547:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085553:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085558:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085564:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085570:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085576:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085582:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085705:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085714:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085720:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.085738:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788836575.098800:0:18703:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9a8178c85400:18703] 0 exiting: rc = 1 00000100:00100000:1.0:1788836575.102706:0:18704:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9a8178c84400:18704] 1 exiting: rc = 0 00000100:00100000:2.0:1788836575.102986:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103010:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103016:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103021:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103026:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103030:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103035:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103039:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103044:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103048:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103052:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103056:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103060:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103065:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103070:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103075:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103080:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103084:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103090:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103095:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103100:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103106:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103111:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103116:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103120:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103126:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103130:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103136:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103154:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103160:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103165:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103190:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103196:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103202:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103207:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103212:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103222:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103226:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103230:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103235:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103240:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103245:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103249:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103253:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103258:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103263:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103268:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103273:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103278:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103282:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103297:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103302:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103307:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103311:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103316:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103320:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103325:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103329:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103334:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103339:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103344:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103349:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103354:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788836575.103364:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.105843:0:18705:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9a80455a3c00:18705] 0 exiting: rc = 1 00000100:00100000:2.0:1788836575.109005:0:18706:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9a80455a3400:18706] 1 exiting: rc = 0 00000100:00100000:1.0:1788836575.109178:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109188:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109213:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109221:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109226:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109247:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109253:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109279:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109295:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109301:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109307:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109313:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109318:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109324:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109329:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109335:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109340:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109346:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109352:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109374:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109383:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109390:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109398:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109405:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109413:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109419:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109426:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109433:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109438:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109444:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109450:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109638:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109646:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109651:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109657:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109664:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109669:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109676:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109681:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109688:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109702:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109707:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109713:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109735:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109742:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109748:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109754:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109761:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109767:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109772:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109778:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109785:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109789:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109796:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109802:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109824:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109830:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109836:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109843:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109849:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109854:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109859:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109865:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788836575.109880:0:21370:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1788836575.130525:0:21370:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788836598.165212:0:22134:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg144-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788836611.557583:0:22734:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788836611.557590:0:22734:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1788836611.557591:0:22734:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788836611.557713:0:22734:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a8166ee6000 00000020:01000004:2.0:1788836611.557733:0:22734:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788836611.557741:0:22734:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788836611.557766:0:22734:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9a81488eb370) 00000020:00000080:2.0:1788836611.557779:0:22734:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788836611.680624:0:22734:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788836611.681495:0:22734:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788836611.682793:0:22734:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1788836611.682981:0:22734:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788836611.683863:0:22734:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1788836611.684119:0:22734:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788836611.684560:0:22734:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1788836611.684776:0:22734:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1788836611.684977:0:22734:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788836611.685368:0:22734:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788836611.688901:0:22734:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788836611.690804:0:22734:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788836611.691146:0:22734:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788836611.691625:0:22734:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1788836611.692483:0:22734:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1788836611.694176:0:22734:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788836611.694608:0:22734:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788836611.694845:0:22734:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788836611.695026:0:22734:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788836611.695202:0:22734:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788836611.695494:0:22734:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788836611.695670:0:22734:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788836611.695898:0:22734:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788836611.696080:0:22734:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788836611.696452:0:22734:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788836611.697211:0:22734:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788836611.697518:0:22734:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1788836611.697737:0:22734:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1788836611.697933:0:22734:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788836611.698187:0:22734:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1788836611.698421:0:22734:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1788836611.698747:0:22734:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788836611.698922:0:22734:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1788836611.699099:0:22734:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788836611.699287:0:22734:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788836611.699530:0:22734:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788836611.699798:0:22734:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788836611.699990:0:22734:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1788836611.700191:0:22734:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1788836611.700604:0:22734:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1788836611.700844:0:22734:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1788836611.701075:0:22734:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1788836611.704930:0:22734:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1788836611.705316:0:22734:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1788836611.705563:0:22734:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788836611.705834:0:22734:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788836611.706084:0:22734:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788836611.708882:0:22734:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1788836611.709360:0:22734:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1788836611.709621:0:22734:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1788836611.710125:0:22734:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1788836611.710332:0:22734:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1788836611.710738:0:22734:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:3.0:1788836611.711229:0:22734:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788836611.711456:0:22734:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788836611.712888:0:22734:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788836611.712912:0:22734:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbd163c7375715f62 00000020:01000004:3.0:1788836611.712921:0:22734:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1788836611.712927:0:22734:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788836611.712935:0:22734:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a8166ee6000 from MGS 00000020:01000004:3.0:1788836611.712940:0:22734:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788836611.712955:0:22734:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9a816c108000) 00000020:00000080:3.0:1788836611.712967:0:22734:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788836611.713040:0:22734:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a8166ee6000 from MGS, refs=2 00080000:01000000:3.0:1788836611.713045:0:22734:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788836611.713051:0:22734:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbd163c7375715f70 00000100:00100000:3.0:1788836611.713187:0:22734:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788836611.713393:0:22734:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788836611.713399:0:22734:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788836611.715110:0:22734:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788836611.715121:0:22734:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788836611.715995:0:22734:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788836611.716192:0:22734:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788836611.716198:0:22734:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788836611.722648:0:22734:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788836611.722677:0:22734:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788836611.728282:0:22734:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788836611.728298:0:22734:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788836611.729194:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836611.729200:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836611.729201:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836611.729592:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836611.729594:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836611.729596:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836611.730150:0:22734:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788836611.732124:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788836611.742540:0:22734:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1788836611.747158:0:22746:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788836611.747527:0:22734:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788836611.747592:0:22734:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788836611.748716:0:22734:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788836611.752990:0:22734:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788836611.753239:0:22734:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788836611.753247:0:22734:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788836611.763299:0:22734:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788836611.763325:0:22734:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788836611.764796:0:22734:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788836611.764805:0:22734:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:2.0:1788836611.765327:0:22751:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:1.0:1788836611.765602:0:22734:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788836611.765624:0:22734:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.144@tcp' 00000020:01000004:1.0:1788836611.765626:0:22734:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788836611.766568:0:22734:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.144@tcp (typ=mgc) 00000020:00000080:1.0:1788836611.766583:0:22734:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.144@tcp (ffff9a815f6019b8) 00000020:00000080:1.0:1788836611.766601:0:22734:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788836611.767047:0:22734:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a816c277800@MGC192.168.201.144@tcp: add connection 192.168.201.144@tcp at head 00010000:00010000:1.0:1788836611.767197:0:22734:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.144@tcp-0 is initialized 00000040:01000000:1.0:1788836611.767922:0:22734:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.144@tcp ctxt 1 is initialized 10000000:01000000:0.0:1788836611.769930:0:22752:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788836611.770035:0:22734:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.144@tcp (uuid 5d9f3bec-9812-4f3e-be22-5440158bfa78) 00000020:00000080:1.0:1788836611.770060:0:22734:0:(genops.c:1385:class_connect()) connect: client 5d9f3bec-9812-4f3e-be22-5440158bfa78, cookie 0xbd163c7375715f7e 00000100:00080000:1.0:1788836611.770075:0:22734:0:(import.c:510:import_select_connection()) MGC192.168.201.144@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788836611.770088:0:22734:0:(import.c:624:import_select_connection()) MGC192.168.201.144@tcp: import ffff9a816c277800 using connection 192.168.201.144@tcp/0@lo 00000100:00100000:1.0:1788836611.770123:0:22734:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8172d95f80 x1875730518756480/t0(0) o250->MGC192.168.201.144@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788836611.770194:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5d9f3bec-9812-4f3e-be22-5440158bfa78:3617:1875730518756480:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788836611.770275:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836611.770385:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518756480 00000100:00100000:2.0:1788836611.770393:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518756480 00000100:00100000:2.0:1788836611.770424:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788836611.770432:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f3e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3617:x1875730518756480:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788836611.770456:0:22748:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 5d9f3bec-9812-4f3e-be22-5440158bfa78@0@lo t0 exp 0000000000000000 cur 641 last 0 00000020:00000080:2.0:1788836611.770504:0:22748:0:(genops.c:1385:class_connect()) connect: client 5d9f3bec-9812-4f3e-be22-5440158bfa78, cookie 0xbd163c7375715f85 00000100:00080000:2.0:1788836611.770629:0:22748:0:(import.c:65:import_set_state_nolock()) ffff9a815153c800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1788836611.770852:0:22734:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 5d9f3bec-9812-4f3e-be22-5440158bfa78->MGS 00000020:01000004:1.0:1788836611.770875:0:22734:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788836611.770898:0:22734:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788836611.770912:0:22734:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9a815f604d28) 00000020:00000080:1.0:1788836611.770922:0:22734:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788836611.773823:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f3e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+5:3617:x1875730518756480:12345-0@lo:250:mount.lustre.0 Request processed in 3378us (3537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836611.773840:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788836611.777773:0:3617:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.144@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788836611.777790:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.144@tcp: connect to target with instance 0 00000100:00080000:0.0:1788836611.777799:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.144@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788836611.777805:0:3617:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788836611.777809:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9a816c277800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788836611.777813:0:3617:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788836611.777822:0:3617:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788836611.777830:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5d9f3bec-9812-4f3e-be22-5440158bfa78:3617:1875730518756480:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788836611.782820:0:22734:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788836611.783052:0:22734:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788836611.783059:0:22734:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788836611.784034:0:22734:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788836611.784044:0:22734:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788836611.784730:0:22734:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788836611.784740:0:22734:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788836611.785436:0:22734:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788836611.785845:0:22734:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788836611.785851:0:22734:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788836611.786358:0:22734:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788836611.786365:0:22734:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788836611.830015:0:22734:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788836611.830261:0:22734:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788836611.830268:0:22734:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788836611.831425:0:22734:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788836611.831435:0:22734:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788836611.832113:0:22734:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788836611.832344:0:22734:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788836611.832351:0:22734:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788836611.833266:0:22734:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788836611.833274:0:22734:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788836611.833952:0:22734:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788836611.834132:0:22734:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788836611.834138:0:22734:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788836611.834762:0:22734:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788836611.834769:0:22734:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788836611.835329:0:22734:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788836611.835641:0:22734:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788836611.835647:0:22734:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788836611.836171:0:22734:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788836611.836178:0:22734:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788836611.855606:0:22734:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788836611.855951:0:22734:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788836611.855959:0:22734:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788836611.857249:0:22734:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788836611.857261:0:22734:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788836611.858209:0:22734:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788836611.858220:0:22734:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788836611.859262:0:22734:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788836611.859293:0:22734:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1788836611.859300:0:22734:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.144@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788836611.859420:0:22734:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.144@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788836611.859582:0:22734:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.144@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788836611.859587:0:22734:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788836611.859589:0:22734:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788836611.859590:0:22734:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788836611.859591:0:22734:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788836611.859592:0:22734:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788836611.859599:0:22734:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788836611.859600:0:22734:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788836611.859602:0:22734:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788836611.859604:0:22734:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788836611.859605:0:22734:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788836611.859608:0:22734:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788836611.859610:0:22734:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788836611.859611:0:22734:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788836611.859612:0:22734:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788836611.859613:0:22734:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788836611.859613:0:22734:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788836611.859614:0:22734:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788836611.859615:0:22734:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788836611.859616:0:22734:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788836611.859617:0:22734:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788836611.859618:0:22734:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788836611.859725:0:22734:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788836611.859749:0:22734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d97b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:22734:1875730518756608:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788836611.859826:0:22734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836611.859906:0:22734:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a80475f0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788836611.859955:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518756608 00000100:00100000:2.0:1788836611.859964:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518756608 00000100:00100000:2.0:1788836611.860008:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788836611.860017:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814700f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+5:22734:x1875730518756608:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788836611.860057:0:22750:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788836611.860059:0:22750:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788836611.860062:0:22750:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1788836611.860343:0:22771:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788836611.860789:0:22750:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:1.0:1788836611.862055:0:22772:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1788836611.862061:0:22772:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1788836611.862063:0:22772:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1788836611.862064:0:22772:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1788836611.862184:0:22772:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1788836611.862371:0:22750:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788836611.862379:0:22750:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788836611.863418:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814700f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+5:22734:x1875730518756608:12345-0@lo:253:mount.lustre.0 Request processed in 3396us (3585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836611.863431:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788836611.863445:0:22734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d97b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:22734:1875730518756608:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788836611.863530:0:22734:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788836611.863535:0:22734:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788836611.863536:0:22734:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788836611.863538:0:22734:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788836611.863539:0:22734:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788836611.863540:0:22734:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788836611.863542:0:22734:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788836611.863543:0:22734:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788836611.863544:0:22734:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788836611.863547:0:22734:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788836611.863554:0:22734:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788836611.863578:0:22734:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a8166ee6000 from lustre-MDT0000 10000000:01000000:1.0:1788836611.863603:0:22734:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788836611.863607:0:22734:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788836611.863611:0:22734:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9a815f6019b8 10000000:01000000:1.0:1788836611.863616:0:22734:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788836611.863624:0:22734:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9a815f6019b8 from 1 10000000:01000000:1.0:1788836611.863627:0:22734:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788836611.863783:0:22734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a817f41a000/0xbd163c7375715f93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836611.863795:0:22734:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.144@tcp lock: ffff9a817f41a000/0xbd163c7375715f93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836611.863805:0:22734:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.144@tcp lock: ffff9a817f41a000/0xbd163c7375715f93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836611.863824:0:22734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d97b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:22734:1875730518756736:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788836611.863864:0:22734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836611.863900:0:22734:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a81647c2540 going to sleep for 11 seconds 00000100:00100000:2.0:1788836611.863957:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518756736 00000100:00100000:2.0:1788836611.863964:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518756736 00000100:00100000:2.0:1788836611.864042:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788836611.864053:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814700cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+5:22734:x1875730518756736:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788836611.864071:0:22748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836611.864087:0:22748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8167975e00/0xbd163c7375715f9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd163c7375715f93 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836611.864111:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8167975e00/0xbd163c7375715f9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd163c7375715f93 expref: 6 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836611.864135:0:22748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8167975e00/0xbd163c7375715f9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd163c7375715f93 expref: 6 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836611.864144:0:22748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8167975e00, rc 0) 00000100:00100000:2.0:1788836611.864185:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814700cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+6:22734:x1875730518756736:12345-0@lo:101:mount.lustre.0 Request processed in 134us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836611.864191:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788836611.864247:0:22734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d97b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:22734:1875730518756736:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788836611.864261:0:22734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.144@tcp lock: ffff9a817f41a000/0xbd163c7375715f93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375715f9a expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836611.864271:0:22734:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.144@tcp lock: ffff9a817f41a000/0xbd163c7375715f93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd163c7375715f9a expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836611.864339:0:22734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d97b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:22734:1875730518756864:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788836611.864365:0:22734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836611.864501:0:22734:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a81647c2540 going to sleep for 11 seconds 00000100:00100000:0.0:1788836611.864645:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518756864 00000100:00100000:0.0:1788836611.864660:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518756864 00000100:00100000:0.0:1788836611.864683:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788836611.864689:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814700ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+6:22734:x1875730518756864:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788836611.864767:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814700ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+6:22734:x1875730518756864:12345-0@lo:501:mount.lustre.0 Request processed in 78us (401us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788836611.864774:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788836611.864900:0:22734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d97b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:22734:1875730518756864:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788836611.864933:0:22734:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.144@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788836611.864952:0:22734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a817f41a000/0xbd163c7375715f93 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375715f9a expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836611.864961:0:22734:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.144@tcp lock: ffff9a817f41a000/0xbd163c7375715f93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375715f9a expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836611.864969:0:22734:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a8166ee6000 10000000:01000000:1.0:1788836611.864974:0:22734:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788836611.864979:0:22734:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9a8166ee6000 10000000:01000000:1.0:1788836611.864981:0:22734:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788836611.864984:0:22734:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9a8166ee6000 from 1 10000000:01000000:1.0:1788836611.864987:0:22734:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788836611.865004:0:22734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a817f41ba00/0xbd163c7375715fa1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836611.865012:0:22734:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.144@tcp lock: ffff9a817f41ba00/0xbd163c7375715fa1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836611.865021:0:22734:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.144@tcp lock: ffff9a817f41ba00/0xbd163c7375715fa1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836611.865032:0:22734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d97b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:22734:1875730518756992:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788836611.865059:0:22734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836611.865082:0:22734:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a81647c2540 going to sleep for 11 seconds 00000100:00100000:0.0:1788836611.865139:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518756992 00000100:00100000:0.0:1788836611.865144:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518756992 00000100:00100000:0.0:1788836611.865163:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788836611.865169:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814700f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+6:22734:x1875730518756992:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788836611.865177:0:22749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836611.865197:0:22749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a804738d800/0xbd163c7375715fa8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd163c7375715fa1 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836611.865213:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a804738d800/0xbd163c7375715fa8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd163c7375715fa1 expref: 7 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836611.865223:0:22749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a804738d800/0xbd163c7375715fa8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd163c7375715fa1 expref: 7 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836611.865229:0:22749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a804738d800, rc 0) 00000100:00100000:0.0:1788836611.865269:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814700f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+7:22734:x1875730518756992:12345-0@lo:101:mount.lustre.0 Request processed in 100us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836611.865275:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788836611.865349:0:22734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d97b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:22734:1875730518756992:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788836611.865362:0:22734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.144@tcp lock: ffff9a817f41ba00/0xbd163c7375715fa1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375715fa8 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836611.865381:0:22734:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.144@tcp lock: ffff9a817f41ba00/0xbd163c7375715fa1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd163c7375715fa8 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836611.865393:0:22734:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.144@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788836611.865408:0:22734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a817f41ba00/0xbd163c7375715fa1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375715fa8 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836611.865415:0:22734:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.144@tcp lock: ffff9a817f41ba00/0xbd163c7375715fa1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375715fa8 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836611.865421:0:22734:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788836611.865424:0:22734:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788836611.865428:0:22734:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9a8166ee6000 10000000:01000000:1.0:1788836611.865431:0:22734:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788836611.865434:0:22734:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788836611.865436:0:22734:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788836611.865449:0:22734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a817f41a400/0xbd163c7375715faf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836611.865455:0:22734:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.144@tcp lock: ffff9a817f41a400/0xbd163c7375715faf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836611.865487:0:22734:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.144@tcp lock: ffff9a817f41a400/0xbd163c7375715faf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836611.865499:0:22734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d97b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:22734:1875730518757120:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788836611.865525:0:22734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836611.865537:0:22734:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a81647c2540 going to sleep for 11 seconds 00000100:00100000:0.0:1788836611.865599:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518757120 00000100:00100000:0.0:1788836611.865604:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518757120 00000100:00100000:0.0:1788836611.865624:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788836611.865631:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814700c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+7:22734:x1875730518757120:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788836611.865638:0:22749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836611.865645:0:22749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a804738c000/0xbd163c7375715fb6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd163c7375715faf expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836611.865669:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a804738c000/0xbd163c7375715fb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd163c7375715faf expref: 8 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836611.865677:0:22749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a804738c000/0xbd163c7375715fb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd163c7375715faf expref: 8 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836611.865683:0:22749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a804738c000, rc 0) 00000100:00100000:0.0:1788836611.865720:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814700c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+8:22734:x1875730518757120:12345-0@lo:101:mount.lustre.0 Request processed in 89us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836611.865734:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788836611.865856:0:22734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d97b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:22734:1875730518757120:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788836611.865869:0:22734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.144@tcp lock: ffff9a817f41a400/0xbd163c7375715faf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375715fb6 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836611.865877:0:22734:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.144@tcp lock: ffff9a817f41a400/0xbd163c7375715faf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd163c7375715fb6 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836611.865920:0:22734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d97b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:22734:1875730518757248:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788836611.865946:0:22734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836611.865973:0:22734:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a81647c2540 going to sleep for 11 seconds 00000100:00100000:0.0:1788836611.866019:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518757248 00000100:00100000:0.0:1788836611.866024:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518757248 00000100:00100000:0.0:1788836611.866042:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788836611.866048:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814700e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+8:22734:x1875730518757248:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788836611.866172:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814700e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+9:22734:x1875730518757248:12345-0@lo:501:mount.lustre.0 Request processed in 123us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836611.866178:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788836611.866241:0:22734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d97b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:22734:1875730518757248:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788836611.866267:0:22734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d97b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:22734:1875730518757376:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788836611.866317:0:22734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836611.866336:0:22734:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a81647c2540 going to sleep for 11 seconds 00000100:00100000:0.0:1788836611.866436:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518757376 00000100:00100000:0.0:1788836611.866441:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518757376 00000100:00100000:0.0:1788836611.866483:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788836611.866491:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814700e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+9:22734:x1875730518757376:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788836611.867171:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814700e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+9:22734:x1875730518757376:12345-0@lo:503:mount.lustre.0 Request processed in 679us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836611.867179:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788836611.867291:0:22734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d97b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:22734:1875730518757376:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788836611.867700:0:22773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d97b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d9f3bec-9812-4f3e-be22-5440158bfa78:22773:1875730518757504:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788836611.867744:0:22773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836611.867779:0:22773:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a81647c2840 going to sleep for 11 seconds 00000100:00100000:0.0:1788836611.867818:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518757504 00000100:00100000:0.0:1788836611.867822:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518757504 00000100:00100000:0.0:1788836611.867846:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788836611.867853:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814700d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+9:22773:x1875730518757504:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788836611.868427:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814700d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+9:22773:x1875730518757504:12345-0@lo:502:llog_process_th.0 Request processed in 572us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836611.868435:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788836611.868555:0:22773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d97b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d9f3bec-9812-4f3e-be22-5440158bfa78:22773:1875730518757504:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788836611.868586:0:22773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788836611.868597:0:22773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836611.868600:0:22773:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788836611.868605:0:22773:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788836611.868608:0:22773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788836611.868624:0:22773:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9a815f603370) 00000020:00000080:1.0:1788836611.868641:0:22773:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788836611.868666:0:22773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788836611.868756:0:22773:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788836611.868764:0:22773:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbd163c7375715fc4 00000020:00000080:1.0:1788836611.868978:0:22773:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788836611.868982:0:22773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788836611.868986:0:22773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836611.868988:0:22773:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788836611.868990:0:22773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788836611.868994:0:22773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836611.868995:0:22773:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788836611.868998:0:22773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788836611.869005:0:22773:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9a815f600000) 00000020:00000080:1.0:1788836611.869014:0:22773:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788836611.869018:0:22773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788836611.869020:0:22773:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788836611.869022:0:22773:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788836611.869028:0:22773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788836611.869065:0:22773:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a8166ee6000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788836611.869078:0:22773:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9a8167943370) 00000020:00000080:1.0:1788836611.869086:0:22773:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788836611.869140:0:22773:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788836611.869146:0:22773:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbd163c7375715fd9 00000020:00000080:1.0:1788836611.869232:0:22773:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788836611.869238:0:22773:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788836611.869242:0:22773:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xbd163c7375715fe0 00080000:01000000:1.0:1788836611.869247:0:22773:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788836611.869251:0:22773:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbd163c7375715fe7 00010000:00010000:1.0:1788836611.919911:0:22773:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1788836611.920372:0:22773:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934628 00000001:00080000:1.0:1788836611.920789:0:22773:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788836611.921393:0:22773:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9a8167940000) 00000020:00000080:1.0:1788836611.921414:0:22773:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1788836611.921527:0:22773:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788836611.921539:0:22773:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbd163c7375715ff5 00000020:00000080:0.0:1788836611.922157:0:22773:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788836611.928882:0:22773:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xbd163c7375715ffc 00000020:00000080:2.0:1788836611.933871:0:22773:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788836611.933887:0:22773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788836611.933898:0:22773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836611.933900:0:22773:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788836611.933903:0:22773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788836611.933905:0:22773:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1788836611.933907:0:22773:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788836611.933908:0:22773:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788836611.933909:0:22773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788836611.933912:0:22773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836611.933913:0:22773:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788836611.933915:0:22773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788836611.933920:0:22773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836611.933922:0:22773:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788836611.933927:0:22773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788836611.933976:0:22773:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788836611.933996:0:22773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788836611.933999:0:22773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836611.934000:0:22773:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788836611.934003:0:22773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788836611.934006:0:22773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836611.934007:0:22773:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1788836611.934023:0:22773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788836611.934028:0:22773:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.144@tcp to nid 0x20000c0a8c990 (192.168.201.144@tcp) 00000020:00000080:2.0:1788836611.934058:0:22773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788836611.934073:0:22773:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9a81488e8000) 00000020:00000080:2.0:1788836611.934090:0:22773:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788836611.934096:0:22773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788836611.934154:0:22773:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1788836611.934159:0:22773:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788836611.934166:0:22773:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbd163c737571600a 00010000:00080000:2.0:1788836611.934198:0:22773:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a81646c4000@lustre-MDT0001-osp-MDT0000: add connection 192.168.201.144@tcp at head 00010000:00010000:2.0:1788836611.940216:0:22773:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1788836611.942374:0:22773:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788836611.942392:0:22773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788836611.942430:0:22773:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788836611.942454:0:22773:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbd163c7375716011 00000100:00080000:2.0:1788836611.942495:0:22773:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788836611.942501:0:22773:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a81646c4000 using connection 192.168.201.144@tcp/0@lo 00000100:00100000:2.0:1788836611.942540:0:22773:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a817f536300 x1875730518757632/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788836611.942567:0:22773:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1788836611.942623:0:22773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788836611.942627:0:22773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836611.942629:0:22773:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1788836611.942632:0:22773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788836611.942635:0:22773:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:2.0:1788836611.942636:0:22773:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788836611.942638:0:22773:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788836611.942639:0:22773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788836611.942642:0:22773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836611.942643:0:22773:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788836611.942645:0:22773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788836611.942856:0:22773:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788836611.942861:0:22773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836611.942863:0:22773:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788836611.942868:0:22773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788836611.942871:0:22773:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.144@tcp to nid 0x20000c0a8c990 (192.168.201.144@tcp) 00000020:01000000:2.0:1788836611.942901:0:22773:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788836611.942905:0:22773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788836611.942919:0:22773:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9a81488e99b8) 00000020:00000080:2.0:1788836611.942933:0:22773:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1788836611.942939:0:22773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788836611.943003:0:22773:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788836611.943009:0:22773:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788836611.943016:0:22773:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbd163c737571601f 00010000:00080000:2.0:1788836611.943049:0:22773:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a815f7e7000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.144@tcp at head 00010000:00010000:2.0:1788836611.943283:0:22773:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:0.0:1788836611.943769:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f536300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875730518757632:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788836611.943862:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836611.944414:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518757632 00000100:00100000:3.0:1788836611.944423:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518757632 00000100:00100000:3.0:1788836611.944456:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788836611.944490:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a816bd76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3617:x1875730518757632:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1788836611.944508:0:22760:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788836611.945817:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788836611.945929:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a81412e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d9f3bec-9812-4f3e-be22-5440158bfa78:3618:1875730518757760:0@lo:400:kworker.0 00000100:00100000:2.0:1788836611.946009:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836611.946982:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518757760 00000100:00100000:0.0:1788836611.946993:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518757760 00000100:00100000:0.0:1788836611.947052:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788836611.947063:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814700dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+9:3618:x1875730518757760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836611.947151:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814700dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+9:3618:x1875730518757760:12345-0@lo:400:kworker.0 Request processed in 90us (1140us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836611.947159:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788836611.947268:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a81412e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d9f3bec-9812-4f3e-be22-5440158bfa78:3618:1875730518757760:0@lo:400:kworker.0 00000040:01000000:2.0:1788836611.948952:0:22773:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788836611.949235:0:22773:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788836611.961144:0:22773:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788836611.962395:0:22773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:2.0:1788836611.972241:0:22773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:2.0:1788836611.974945:0:22779:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788836611.974956:0:22779:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788836611.977861:0:22773:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788836611.977879:0:22773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788836611.977928:0:22773:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788836611.977952:0:22773:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbd163c7375716026 00000100:00080000:2.0:1788836611.977994:0:22773:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788836611.978002:0:22773:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a815f7e7000 using connection 192.168.201.144@tcp/0@lo 00000100:00100000:2.0:1788836611.978042:0:22773:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a817f534380 x1875730518757888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788836611.978068:0:22773:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788836611.978135:0:22773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788836611.978142:0:22773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836611.978144:0:22773:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788836611.978148:0:22773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788836611.978151:0:22773:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1788836611.978153:0:22773:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788836611.978155:0:22773:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788836611.978156:0:22773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788836611.978159:0:22773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836611.978161:0:22773:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788836611.978163:0:22773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788836611.978168:0:22773:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788836611.978173:0:22773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836611.978175:0:22773:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788836611.978178:0:22773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788836611.978182:0:22773:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.144@tcp to nid 0x20000c0a8c990 (192.168.201.144@tcp) 00000020:01000000:2.0:1788836611.978226:0:22773:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788836611.978229:0:22773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788836611.978244:0:22773:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9a81488ecd28) 00000020:00000080:2.0:1788836611.978987:0:22773:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1788836611.978998:0:22773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788836611.979076:0:22773:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788836611.979084:0:22773:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:2.0:1788836611.979090:0:22773:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbd163c7375716034 00010000:00080000:2.0:1788836611.979122:0:22773:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a8158dbd800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.144@tcp at head 00010000:00010000:2.0:1788836611.979817:0:22773:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1788836611.979917:0:22773:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788836611.979932:0:22773:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:0.0:1788836611.980357:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f534380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875730518757888:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788836611.980425:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875730518757888 offset 0 length 520: 4 00000040:00080000:2.0:1788836611.983182:0:22773:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788836611.984937:0:22773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:2.0:1788836611.985128:0:22773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000100:00100000:3.0:1788836611.985403:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a816bd76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3617:x1875730518757632:12345-0@lo:38:llog_process_th.0 Request processed in 40907us (41534us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788836611.985417:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788836611.985516:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9a81646c4000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788836611.985524:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788836611.985528:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f536300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875730518757632:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788836611.987347:0:22781:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788836611.987355:0:22781:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788836611.988089:0:22773:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788836611.988100:0:22773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788836611.988131:0:22773:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788836611.988147:0:22773:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbd163c737571603b 00000100:00080000:2.0:1788836611.988157:0:22773:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788836611.988161:0:22773:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a8158dbd800 using connection 192.168.201.144@tcp/0@lo 00000100:00100000:2.0:1788836611.988332:0:22773:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a817f536d80 x1875730518758016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788836611.988396:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f536d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875730518758016:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788836611.988452:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875730518758016 offset 0 length 520: 4 00000100:00080000:2.0:1788836611.988622:0:22773:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788836611.988993:0:22773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788836611.988999:0:22773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836611.989001:0:22773:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788836611.989004:0:22773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788836611.989008:0:22773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836611.989009:0:22773:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788836611.989012:0:22773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788836611.989014:0:22773:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788836611.989016:0:22773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788836611.989018:0:22773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836611.989019:0:22773:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788836611.989021:0:22773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788836611.989023:0:22773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836611.989024:0:22773:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788836611.989027:0:22773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788836611.989062:0:22773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f535500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d9f3bec-9812-4f3e-be22-5440158bfa78:22773:1875730518758144:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788836611.989124:0:22773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836611.989157:0:22773:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a817f4b7780 going to sleep for 11 seconds 00000100:00100000:3.0:1788836611.989358:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518758144 00000100:00100000:3.0:1788836611.989366:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518758144 00000100:00100000:3.0:1788836611.989418:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788836611.989428:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814700c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+9:22773:x1875730518758144:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788836611.990016:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814700c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+9:22773:x1875730518758144:12345-0@lo:502:llog_process_th.0 Request processed in 588us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836611.990025:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788836611.990084:0:22773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f535500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d9f3bec-9812-4f3e-be22-5440158bfa78:22773:1875730518758144:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788836611.990119:0:22773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788836611.990125:0:22773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836611.990127:0:22773:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788836611.990131:0:22773:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1788836611.990435:0:22734:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1788836611.990458:0:22734:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.144@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788836611.990741:0:22734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a817f41a400/0xbd163c7375715faf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375715fb6 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836611.990753:0:22734:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.144@tcp lock: ffff9a817f41a400/0xbd163c7375715faf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375715fb6 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836611.990762:0:22734:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a8166ee6000 from 1 10000000:01000000:0.0:1788836611.990766:0:22734:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788836611.990807:0:22734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a804738cc00/0xbd163c7375716042 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836611.990816:0:22734:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.144@tcp lock: ffff9a804738cc00/0xbd163c7375716042 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836611.990829:0:22734:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.144@tcp lock: ffff9a804738cc00/0xbd163c7375716042 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836611.990991:0:22734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:22734:1875730518758272:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788836611.991050:0:22734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836611.991090:0:22734:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a817f5ad000 going to sleep for 11 seconds 00000100:00100000:2.0:1788836611.991150:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518758272 00000100:00100000:2.0:1788836611.991158:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518758272 00000100:00100000:2.0:1788836611.991890:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788836611.991905:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814700d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+9:22734:x1875730518758272:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788836611.991934:0:22748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836611.991954:0:22748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8167974e00/0xbd163c7375716049 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd163c7375716042 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836611.991983:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8167974e00/0xbd163c7375716049 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd163c7375716042 expref: 10 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836611.991997:0:22748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8167974e00/0xbd163c7375716049 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd163c7375716042 expref: 10 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836611.992007:0:22748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8167974e00, rc 0) 00000100:00100000:2.0:1788836611.992068:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814700d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+10:22734:x1875730518758272:12345-0@lo:101:mount.lustre.0 Request processed in 168us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836611.992076:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788836611.992489:0:22734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:22734:1875730518758272:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788836611.992521:0:22734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.144@tcp lock: ffff9a804738cc00/0xbd163c7375716042 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375716049 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836611.992532:0:22734:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.144@tcp lock: ffff9a804738cc00/0xbd163c7375716042 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd163c7375716049 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836611.993091:0:22734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a81412ebb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:22734:1875730518758400:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788836611.993150:0:22734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836611.993185:0:22734:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a815091ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1788836611.993691:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518758400 00000100:00100000:2.0:1788836611.993698:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518758400 00000100:00100000:2.0:1788836611.993753:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788836611.993762:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814700c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+10:22734:x1875730518758400:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788836611.993781:0:22750:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788836611.993788:0:22750:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788836611.994033:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814700c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+10:22734:x1875730518758400:12345-0@lo:256:mount.lustre.0 Request processed in 271us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836611.994042:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788836611.994185:0:22734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a81412ebb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:22734:1875730518758400:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788836611.995400:0:22734:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788836611.995491:0:22734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a804738cc00/0xbd163c7375716042 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375716049 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836611.995505:0:22734:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.144@tcp lock: ffff9a804738cc00/0xbd163c7375716042 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375716049 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836611.995791:0:22734:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a8166ee6000 from 1 10000000:01000000:2.0:1788836611.995796:0:22734:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788836611.995858:0:22734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a8167974c00/0xbd163c7375716050 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836611.995867:0:22734:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.144@tcp lock: ffff9a8167974c00/0xbd163c7375716050 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836611.995878:0:22734:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.144@tcp lock: ffff9a8167974c00/0xbd163c7375716050 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836611.995903:0:22734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f535500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:22734:1875730518758528:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788836611.995966:0:22734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836611.995999:0:22734:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a817f4b7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836611.996113:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518758528 00000100:00100000:3.0:1788836611.996121:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518758528 00000100:00100000:3.0:1788836611.996174:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788836611.996185:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814700e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+10:22734:x1875730518758528:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788836611.996209:0:22748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836611.996225:0:22748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a80462e7200/0xbd163c7375716057 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd163c7375716050 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836611.996246:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a80462e7200/0xbd163c7375716057 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd163c7375716050 expref: 11 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836611.996285:0:22748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a80462e7200/0xbd163c7375716057 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd163c7375716050 expref: 11 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836611.996295:0:22748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a80462e7200, rc 0) 00000100:00100000:3.0:1788836611.996345:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814700e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+11:22734:x1875730518758528:12345-0@lo:101:mount.lustre.0 Request processed in 162us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836611.996352:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788836611.996845:0:22734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f535500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:22734:1875730518758528:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788836611.996862:0:22734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.144@tcp lock: ffff9a8167974c00/0xbd163c7375716050 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375716057 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836611.996872:0:22734:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.144@tcp lock: ffff9a8167974c00/0xbd163c7375716050 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd163c7375716057 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836611.996943:0:22734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f535500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:22734:1875730518758656:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788836611.996986:0:22734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836611.997009:0:22734:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a817f4b7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836611.997128:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518758656 00000100:00100000:1.0:1788836611.997134:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518758656 00000100:00100000:1.0:1788836611.997174:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788836611.997183:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814700d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+11:22734:x1875730518758656:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788836611.997586:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814700d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+11:22734:x1875730518758656:12345-0@lo:501:mount.lustre.0 Request processed in 404us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836611.997595:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788836611.997810:0:22734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f535500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:22734:1875730518758656:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788836611.997954:0:22734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f535500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:22734:1875730518758784:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788836611.997997:0:22734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836611.998029:0:22734:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a817f4b7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836611.998079:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518758784 00000100:00100000:3.0:1788836611.998084:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518758784 00000100:00100000:3.0:1788836611.998116:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788836611.998124:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8158daf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+11:22734:x1875730518758784:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788836611.998398:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8158daf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+11:22734:x1875730518758784:12345-0@lo:503:mount.lustre.0 Request processed in 274us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836611.998405:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788836611.998563:0:22734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f535500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:22734:1875730518758784:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788836611.999917:0:22783:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd74a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d9f3bec-9812-4f3e-be22-5440158bfa78:22783:1875730518758912:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788836611.999986:0:22783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836612.000028:0:22783:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a817f5ad780 going to sleep for 11 seconds 00000100:00100000:3.0:1788836612.000141:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518758912 00000100:00100000:3.0:1788836612.000148:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518758912 00000100:00100000:3.0:1788836612.000204:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788836612.000214:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8158dad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+11:22783:x1875730518758912:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788836612.000938:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8158dad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+11:22783:x1875730518758912:12345-0@lo:502:llog_process_th.0 Request processed in 723us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836612.000948:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788836612.001098:0:22783:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd74a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d9f3bec-9812-4f3e-be22-5440158bfa78:22783:1875730518758912:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788836612.001134:0:22783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788836612.001143:0:22783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836612.001146:0:22783:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788836612.001152:0:22783:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a8166ee6000 00000020:00000080:0.0:1788836612.001154:0:22783:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788836612.001162:0:22783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788836612.001164:0:22783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836612.001165:0:22783:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788836612.001167:0:22783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788836612.001169:0:22783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836612.001170:0:22783:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788836612.001173:0:22783:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a8166ee6000 00000020:00000080:0.0:1788836612.001175:0:22783:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788836612.001234:0:22783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788836612.001238:0:22783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836612.001239:0:22783:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788836612.001241:0:22783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788836612.001244:0:22783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836612.001245:0:22783:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788836612.001248:0:22783:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a8166ee6000 00000020:00000080:0.0:1788836612.001250:0:22783:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788836612.001279:0:22783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788836612.001282:0:22783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836612.001283:0:22783:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788836612.001285:0:22783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788836612.001297:0:22783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836612.001307:0:22783:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788836612.001312:0:22783:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a8166ee6000 00000020:00000080:0.0:1788836612.001314:0:22783:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788836612.001355:0:22783:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd74a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d9f3bec-9812-4f3e-be22-5440158bfa78:22783:1875730518759040:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788836612.001394:0:22783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836612.001425:0:22783:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a817f5ad780 going to sleep for 11 seconds 00000100:00100000:2.0:1788836612.001658:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518759040 00000100:00100000:2.0:1788836612.001665:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518759040 00000100:00100000:2.0:1788836612.001709:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788836612.001717:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f415450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+11:22783:x1875730518759040:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788836612.001973:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f415450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+11:22783:x1875730518759040:12345-0@lo:502:llog_process_th.0 Request processed in 114us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836612.001981:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788836612.002024:0:22783:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd74a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d9f3bec-9812-4f3e-be22-5440158bfa78:22783:1875730518759040:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788836612.002046:0:22783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788836612.002051:0:22783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836612.002053:0:22783:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788836612.002057:0:22783:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788836612.002124:0:22734:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788836612.002145:0:22734:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788836612.002167:0:22734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a8167974c00/0xbd163c7375716050 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375716057 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836612.002177:0:22734:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.144@tcp lock: ffff9a8167974c00/0xbd163c7375716050 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375716057 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836612.002236:0:22734:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788836612.002240:0:22734:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a8166ee6000 10000000:01000000:2.0:1788836612.002243:0:22734:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a8166ee6000 10000000:01000000:2.0:1788836612.002247:0:22734:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788836612.002261:0:22734:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a8166ee6000 from 1 10000000:01000000:2.0:1788836612.002264:0:22734:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788836612.002293:0:22734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a8167974600/0xbd163c737571605e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836612.002312:0:22734:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.144@tcp lock: ffff9a8167974600/0xbd163c737571605e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836612.002321:0:22734:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.144@tcp lock: ffff9a8167974600/0xbd163c737571605e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836612.002337:0:22734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f535500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:22734:1875730518759168:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788836612.002369:0:22734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836612.002393:0:22734:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a817f4b76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788836612.003859:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518759168 00000100:00100000:2.0:1788836612.003869:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518759168 00000100:00100000:2.0:1788836612.003919:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788836612.003929:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f414850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+11:22734:x1875730518759168:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788836612.003946:0:22748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836612.003965:0:22748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8167975a00/0xbd163c7375716065 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd163c737571605e expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836612.003991:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8167975a00/0xbd163c7375716065 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd163c737571605e expref: 12 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836612.004015:0:22748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8167975a00/0xbd163c7375716065 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd163c737571605e expref: 12 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836612.004025:0:22748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8167975a00, rc 0) 00000100:00100000:2.0:1788836612.004086:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f414850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+12:22734:x1875730518759168:12345-0@lo:101:mount.lustre.0 Request processed in 159us (1716us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836612.004093:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788836612.004145:0:22734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f535500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:22734:1875730518759168:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788836612.004162:0:22734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.144@tcp lock: ffff9a8167974600/0xbd163c737571605e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375716065 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836612.004172:0:22734:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.144@tcp lock: ffff9a8167974600/0xbd163c737571605e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd163c7375716065 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836612.004248:0:22734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f535500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:22734:1875730518759296:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788836612.004292:0:22734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836612.004328:0:22734:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a817f4b76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788836612.004344:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518759296 00000100:00100000:2.0:1788836612.004347:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518759296 00000100:00100000:2.0:1788836612.004369:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788836612.004374:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f414c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+12:22734:x1875730518759296:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788836612.004844:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f414c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+12:22734:x1875730518759296:12345-0@lo:501:mount.lustre.0 Request processed in 468us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836612.004853:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788836612.004890:0:22734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f535500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:22734:1875730518759296:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788836612.004930:0:22734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f535500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:22734:1875730518759424:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788836612.004968:0:22734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836612.005026:0:22734:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a817f4b76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836612.008700:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518759424 00000100:00100000:0.0:1788836612.008718:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518759424 00000100:00100000:0.0:1788836612.008787:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788836612.008797:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f417450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+12:22734:x1875730518759424:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788836612.009086:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f417450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+12:22734:x1875730518759424:12345-0@lo:503:mount.lustre.0 Request processed in 290us (4117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836612.009095:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788836612.009374:0:22734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f535500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:22734:1875730518759424:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788836612.010008:0:22786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd77100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d9f3bec-9812-4f3e-be22-5440158bfa78:22786:1875730518759552:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788836612.010064:0:22786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836612.010093:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518759552 00000100:00100000:0.0:1788836612.010098:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518759552 00000100:00100000:0.0:1788836612.010138:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788836612.010147:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f415c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+12:22786:x1875730518759552:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788836612.010376:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f415c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+12:22786:x1875730518759552:12345-0@lo:502:llog_process_th.0 Request processed in 230us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836612.010384:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788836612.010430:0:22786:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a817f5ada80 going to sleep for 11 seconds 00000100:00100000:0.0:1788836612.010446:0:22786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd77100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d9f3bec-9812-4f3e-be22-5440158bfa78:22786:1875730518759552:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788836612.010601:0:22786:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788836612.010620:0:22786:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9a817f3f8000) 00000020:00000080:0.0:1788836612.010641:0:22786:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:0.0:1788836612.010940:0:22786:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a8166ee6000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788836612.010945:0:22786:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a8166ee6000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788836612.010947:0:22786:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8166ee6000 4 00010000:00080000:0.0:1788836612.010976:0:22786:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a804661a800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.144@tcp at head 00010000:00010000:0.0:1788836612.023580:0:22786:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:0.0:1788836612.024776:0:22786:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788836612.024823:0:22786:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788836612.025752:0:22786:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xbd163c7375716073 00000100:00080000:0.0:1788836612.025768:0:22786:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788836612.025775:0:22786:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9a804661a800 using connection 192.168.201.144@tcp/0@lo 00000100:00100000:0.0:1788836612.025816:0:22786:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a816bd77100 x1875730518759680/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788836612.026563:0:22786:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788836612.028325:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875730518759680:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788836612.028409:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836612.030055:0:22786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd74000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d9f3bec-9812-4f3e-be22-5440158bfa78:22786:1875730518759808:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788836612.030161:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518759680 00000100:00100000:1.0:1788836612.030170:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518759680 00000100:00100000:0.0:1788836612.030809:0:22786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836612.030962:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788836612.030971:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f535500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3617:x1875730518759680:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788836612.031031:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f535500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3617:x1875730518759680:12345-0@lo:38:llog_process_th.0 Request processed in 60us (2621us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788836612.031039:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788836612.031597:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788836612.031606:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9a804661a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788836612.031612:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788836612.031616:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875730518759680:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788836612.031744:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518759808 00000100:00100000:0.0:1788836612.031750:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518759808 00000100:00100000:0.0:1788836612.031790:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788836612.031798:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f414450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+12:22786:x1875730518759808:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788836612.033360:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f414450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+12:22786:x1875730518759808:12345-0@lo:502:llog_process_th.0 Request processed in 1556us (2547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836612.033373:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788836612.033456:0:22786:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a817f5adf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788836612.037411:0:22786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd74000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d9f3bec-9812-4f3e-be22-5440158bfa78:22786:1875730518759808:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788836612.037515:0:22786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd74000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d9f3bec-9812-4f3e-be22-5440158bfa78:22786:1875730518759936:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788836612.037601:0:22786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836612.037653:0:22786:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a817f5adf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788836612.041335:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518759936 00000100:00100000:1.0:1788836612.041353:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518759936 00000100:00100000:1.0:1788836612.041428:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788836612.041440:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f416c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+12:22786:x1875730518759936:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788836612.041673:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f416c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+12:22786:x1875730518759936:12345-0@lo:502:llog_process_th.0 Request processed in 234us (4072us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836612.041681:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788836612.044723:0:22786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd74000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5d9f3bec-9812-4f3e-be22-5440158bfa78:22786:1875730518759936:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788836612.044775:0:22786:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788836612.045078:0:22734:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788836612.045103:0:22734:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788836612.045127:0:22734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a8167974600/0xbd163c737571605e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375716065 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836612.045138:0:22734:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.144@tcp lock: ffff9a8167974600/0xbd163c737571605e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375716065 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788836612.045188:0:22734:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788836612.045354:0:22734:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788836612.045356:0:22734:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788836612.045357:0:22734:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788836612.045358:0:22734:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788836612.045360:0:22734:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788836612.045361:0:22734:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788836612.045363:0:22734:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788836612.045366:0:22734:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788836612.045367:0:22734:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788836612.045371:0:22734:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788836612.045379:0:22734:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788836612.045380:0:22734:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788836612.045381:0:22734:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788836612.045382:0:22734:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788836612.045382:0:22734:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788836612.045383:0:22734:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788836612.045384:0:22734:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788836612.045385:0:22734:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788836612.045386:0:22734:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788836612.045386:0:22734:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788836612.045410:0:22734:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788836612.045428:0:22734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f535c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:22734:1875730518760064:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788836612.045617:0:22734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836612.045707:0:22734:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a817f4b73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836612.051607:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518760064 00000100:00100000:1.0:1788836612.051632:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518760064 00000100:00100000:3.0:1788836612.051996:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788836612.052008:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f417050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+12:22734:x1875730518760064:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788836612.052045:0:22749:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788836612.052061:0:22749:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788836612.061958:0:22749:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788836612.061983:0:22749:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788836612.062340:0:22771:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788836612.062346:0:22771:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788836612.062372:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a817f41b800/0xbd163c737571607a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836612.062392:0:22771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8167974e00/0xbd163c7375716049 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd163c7375716042 expref: 12 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836612.062401:0:22771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a817f41b800/0xbd163c737571607a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836612.062443:0:22771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8167974e00/0xbd163c7375716049 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd163c7375716042 expref: 12 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836612.063615:0:22771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8167974e00/0xbd163c7375716049 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd163c7375716042 expref: 12 pid: 22748 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836612.063635:0:22771:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d97b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22771:1875730518760192:0@lo:104: 00000100:00100000:3.0:1788836612.063812:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f417050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+12:22734:x1875730518760064:12345-0@lo:253:mount.lustre.0 Request processed in 11803us (18190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836612.063825:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788836612.064591:0:22771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836612.064635:0:22771:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8167bfdb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788836612.064917:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518760192 00000100:00100000:0.0:1788836612.064926:0:22738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518760192 00000100:00100000:0.0:1788836612.064973:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788836612.064982:0:22738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8172d97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d9f3bec-9812-4f3e-be22-5440158bfa78+3:22771:x1875730518760192:12345-0@lo:104: 00010000:00010000:0.0:1788836612.064998:0:22738:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.144@tcp lock: ffff9a804738cc00/0xbd163c7375716042 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd163c7375716049 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836612.065057:0:22738:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788836612.065063:0:22738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8172d97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d9f3bec-9812-4f3e-be22-5440158bfa78+3:22771:x1875730518760192:12345-0@lo:104: Request processed in 84us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836612.065070:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788836612.065103:0:22771:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d97b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22771:1875730518760192:0@lo:104: 00010000:00010000:0.0:1788836612.065124:0:22771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a817f41b800/0xbd163c737571607a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836612.065406:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836612.065413:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.144@tcp lock: ffff9a804738cc00/0xbd163c7375716042 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd163c7375716049 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836612.065421:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a804738cc00 already unused, calling callback (ffffffffc139ec20) 10000000:00010000:3.0:1788836612.065425:0:22744:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.144@tcp lock: ffff9a804738cc00/0xbd163c7375716042 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd163c7375716049 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836612.065433:0:22744:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.144@tcp lock: ffff9a804738cc00/0xbd163c7375716042 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd163c7375716049 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788836612.065440:0:22744:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.144@tcp lock: ffff9a804738cc00/0xbd163c7375716042 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd163c7375716049 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836612.065445:0:22744:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788836612.065565:0:22744:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.144@tcp lock: ffff9a804738cc00/0xbd163c7375716042 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd163c7375716049 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836612.065573:0:22744:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788836612.065593:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.144@tcp lock: ffff9a804738cc00/0xbd163c7375716042 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd163c7375716049 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836612.065599:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.144@tcp lock: ffff9a804738cc00/0xbd163c7375716042 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd163c7375716049 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836612.065614:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836612.065624:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836612.065626:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836612.065667:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a81412ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d9f3bec-9812-4f3e-be22-5440158bfa78:3620:1875730518760320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788836612.065708:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836612.065798:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518760320 00000100:00100000:3.0:1788836612.065803:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518760320 00010000:00010000:3.0:1788836612.065821:0:22740:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8167974e00/0xbd163c7375716049 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd163c7375716042 expref: 12 pid: 22748 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836612.066008:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788836612.066016:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81412ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d9f3bec-9812-4f3e-be22-5440158bfa78+12:3620:x1875730518760320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788836612.066028:0:22740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836612.066034:0:22740:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8167974e00/0xbd163c7375716049 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd163c7375716042 expref: 12 pid: 22748 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836612.066048:0:22740:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8167974e00/0xbd163c7375716049 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd163c7375716042 expref: 12 pid: 22748 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836612.066064:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8167974e00/0xbd163c7375716049 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd163c7375716042 expref: 12 pid: 22748 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836612.066078:0:22740:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a817f41b800/0xbd163c737571607a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836612.066090:0:22740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a817f41b800/0xbd163c737571607a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788836612.066106:0:22740:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003760653s 00010000:00010000:3.0:1788836612.066111:0:22740:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a817f41b800/0xbd163c737571607a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836612.066132:0:22740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a817f41b800/0xbd163c737571607a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836612.066138:0:22740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a817f41b800/0xbd163c737571607a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836612.066144:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a817f41b800/0xbd163c737571607a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836612.066149:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a817f41b800 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:3.0:1788836612.066152:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a817f41b800/0xbd163c737571607a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836612.066159:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a817f41b800/0xbd163c737571607a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836612.066173:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a817f41b800/0xbd163c737571607a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836612.066183:0:22740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836612.066217:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81412ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d9f3bec-9812-4f3e-be22-5440158bfa78+11:3620:x1875730518760320:12345-0@lo:103:ldlm_bl.0 Request processed in 200us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836612.066226:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788836612.066348:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a81412ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d9f3bec-9812-4f3e-be22-5440158bfa78:3620:1875730518760320:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788836612.066375:0:22771:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a817f41b800/0xbd163c737571607a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836612.066383:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a817f41b800/0xbd163c737571607a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836612.066399:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a817f41b800/0xbd163c737571607a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836612.068969:0:22734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f535c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:22734:1875730518760064:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788836612.068990:0:22734:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788836612.068994:0:22734:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788836612.068996:0:22734:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788836612.068998:0:22734:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788836612.068999:0:22734:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788836612.069000:0:22734:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788836612.069002:0:22734:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788836612.069003:0:22734:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788836612.069005:0:22734:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788836612.069007:0:22734:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788836612.069009:0:22734:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788836612.069023:0:22734:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:2.0:1788836612.097775:0:22734:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:3.0:1788836612.098185:0:22734:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1788836612.098620:0:22796:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788836612.098754:0:22734:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:0.0:1788836612.099195:0:22796:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:2.0:1788836612.101377:0:22795:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:2.0:1788836612.101386:0:22795:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000100:00080000:2.0:1788836612.101745:0:22797:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9a817f535c00 x1875730518760448/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836612.101759:0:22797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8179dd8300 going to sleep for 0 seconds 00000040:01000000:3.0:1788836612.102816:0:22734:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788836612.102987:0:22734:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788836612.104103:0:22734:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788836612.104116:0:22734:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788836612.104174:0:22734:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788836612.104974:0:22796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788836612.105046:0:22796:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:3.0:1788836612.106801:0:22734:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788836612.107333:0:22734:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788836612.107364:0:22734:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788836612.108621:0:22734:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:3.0:1788836612.109533:0:22734:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:3.0:1788836612.112142:0:22734:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:0.0:1788836612.115037:0:22734:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788836612.115079:0:22734:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffae36c197f988 00100000:10000000:0.0:1788836612.115089:0:22734:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788836612.125849:0:22734:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788836612.125868:0:22734:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.144@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788836612.125888:0:22734:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:1.0:1788836612.125910:0:22734:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1788836612.127029:0:22734:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788836612.127419:0:22734:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788836612.786216:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788836613.094181:0:22791:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788836613.094196:0:22791:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788836613.100675:0:22791:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788836613.100693:0:22791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 10000000:01000000:2.0:1788836613.101540:0:22752:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788836613.101546:0:22752:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a8166ee6000 from 11 10000000:01000000:2.0:1788836613.101550:0:22752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788836613.101598:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a8167975400/0xbd163c7375716081 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836613.101610:0:22752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.144@tcp lock: ffff9a8167975400/0xbd163c7375716081 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836613.101621:0:22752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.144@tcp lock: ffff9a8167975400/0xbd163c7375716081 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836613.101648:0:22752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f534000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518760576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788836613.101728:0:22752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836613.101783:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8179dd89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788836613.101805:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518760576 00000100:00100000:2.0:1788836613.101812:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518760576 00000100:00100000:2.0:1788836613.101859:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788836613.101869:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f417c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+11:22752:x1875730518760576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788836613.101885:0:22750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836613.101902:0:22750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8167974000/0xbd163c7375716088 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd163c7375716081 expref: -99 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836613.101925:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8167974000/0xbd163c7375716088 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd163c7375716081 expref: 12 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836613.101936:0:22750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8167974000/0xbd163c7375716088 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd163c7375716081 expref: 12 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836613.101953:0:22750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8167974000, rc 0) 00000100:00100000:2.0:1788836613.101999:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f417c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+12:22752:x1875730518760576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836613.102006:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788836613.102055:0:22752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f534000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518760576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788836613.102071:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.144@tcp lock: ffff9a8167975400/0xbd163c7375716081 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375716088 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836613.102081:0:22752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.144@tcp lock: ffff9a8167975400/0xbd163c7375716081 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd163c7375716088 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836613.102130:0:22752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f534000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518760704:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788836613.102158:0:22752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836613.102174:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8179dd89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788836613.102187:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518760704 00000100:00100000:2.0:1788836613.102190:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518760704 00000100:00100000:2.0:1788836613.102213:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788836613.102219:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f415850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+12:22752:x1875730518760704:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788836613.102232:0:22749:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788836613.102246:0:22749:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788836613.102249:0:22749:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1788836613.102337:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f415850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+12:22752:x1875730518760704:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 117us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836613.102344:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788836613.102372:0:22752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f534000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518760704:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788836613.102417:0:22752:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788836613.102423:0:22752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a8167975400/0xbd163c7375716081 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375716088 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836613.102431:0:22752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.144@tcp lock: ffff9a8167975400/0xbd163c7375716081 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375716088 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836613.163054:0:22797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8179dd8300 going to sleep for 0 seconds 00010000:00010000:1.0:1788836613.798680:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788836614.118718:0:22791:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788836614.118725:0:22791:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788836614.118858:0:22791:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:2.0:1788836614.118900:0:22791:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788836614.119042:0:22791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:3.0:1788836614.184416:0:22797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8179dd8300 going to sleep for 0 seconds 00010000:00010000:1.0:1788836614.821785:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836615.207539:0:22797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8179dd8300 going to sleep for 0 seconds 00010000:00010000:1.0:1788836615.846740:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836616.236617:0:22797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8179dd8300 going to sleep for 0 seconds 00010000:00010000:1.0:1788836616.871115:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788836617.061659:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788836617.061665:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788836617.061669:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a81646c4000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788836617.061677:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 642 00000100:00080000:3.0:1788836617.061683:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788836617.061697:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a81646c4000 using connection 192.168.201.144@tcp/0@lo 00000100:00100000:3.0:1788836617.061718:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a81412eb800 x1875730518760960/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788836617.061737:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788836617.061747:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788836617.061750:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788836617.061753:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788836617.061756:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788836617.061758:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788836617.061760:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a804661a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788836617.061765:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9a804661a800 using connection 192.168.201.144@tcp/0@lo 00000100:00100000:3.0:1788836617.061776:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a81412e9880 x1875730518761088/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788836617.061808:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a81412eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875730518760960:0@lo:38:kworker.0 00000100:00100000:3.0:1788836617.061907:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836617.061950:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a81412e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875730518761088:0@lo:38:kworker.0 00000100:00100000:3.0:1788836617.061973:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836617.062085:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a81412ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d9f3bec-9812-4f3e-be22-5440158bfa78:3621:1875730518760832:0@lo:400:kworker.0 00000100:00100000:0.0:1788836617.062129:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836617.062185:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518760960 00000100:00100000:0.0:1788836617.062196:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518760960 00000100:00100000:0.0:1788836617.062236:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788836617.062243:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81412e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3617:x1875730518760960:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788836617.062258:0:22761:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788836617.062307:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81412e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3617:x1875730518760960:12345-0@lo:38:kworker.0 Request processed in 53us (390us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788836617.062313:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788836617.062344:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9a81646c4000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788836617.062348:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788836617.062352:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a81412eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875730518760960:0@lo:38:kworker.0 00000100:00100000:3.0:1788836617.062764:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518760832 00000100:00100000:3.0:1788836617.062770:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518760832 00000100:00100000:3.0:1788836617.062808:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788836617.062816:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f416450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+12:3621:x1875730518760832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836617.062869:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f416450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+12:3621:x1875730518760832:12345-0@lo:400:kworker.0 Request processed in 55us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836617.062876:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788836617.062916:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a81412ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d9f3bec-9812-4f3e-be22-5440158bfa78:3621:1875730518760832:0@lo:400:kworker.0 00000100:00100000:1.0:1788836617.065092:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518761088 00000100:00100000:1.0:1788836617.065108:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518761088 00000100:00100000:1.0:1788836617.065187:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788836617.065196:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81412e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3617:x1875730518761088:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788836617.065237:0:22756:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 647 last 0 00000020:00000080:1.0:1788836617.066418:0:22756:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xbd163c737571608f 00000004:00100000:1.0:1788836617.066444:0:22756:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788836617.066621:0:22756:0:(import.c:65:import_set_state_nolock()) ffff9a815f7e0800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788836617.066909:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81412e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875730518761088:12345-0@lo:38:kworker.0 Request processed in 1712us (4932us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836617.066920:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788836617.074870:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a81412e9880 x1875730518761088/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788836627 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788836617.074908:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1788836617.074917:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788836617.074924:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788836617.074928:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9a804661a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788836617.074937:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a81412e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875730518761088:0@lo:38:kworker.0 00000001:02000400:1.0:1788836617.229113:0:23039:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg144-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788836617.256644:0:22797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8179dd8300 going to sleep for 0 seconds 00010000:00010000:2.0:1788836617.893794:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836618.278166:0:22797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8179dd8300 going to sleep for 0 seconds 00000020:00000004:3.0:1788836618.320786:0:23092:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788836618.320977:0:23092:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788836618.918645:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788836619.201904:0:23142:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788836619.202098:0:23142:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788836619.302716:0:22797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8179dd8300 going to sleep for 0 seconds 00010000:00010000:2.0:1788836619.947493:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836620.327082:0:22797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8179dd8300 going to sleep for 0 seconds 00010000:00010000:1.0:1788836620.969246:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836621.157806:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788836611/real 1788836611] req@ffff9a817f536d80 x1875730518758016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836621 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836621.157835:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a817f536d80 x1875730518758016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836621 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836621.157845:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788836611/real 1788836611] req@ffff9a817f534380 x1875730518757888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836621 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836621.157857:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a817f534380 x1875730518757888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836621 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788836621.157874:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9a8158dbd800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788836621.157903:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788836621.157916:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f536d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875730518758016:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788836621.157923:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9a815f7e7000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788836621.157928:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788836621.157931:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f534380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875730518757888:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788836621.158047:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788836621.158052:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788836621.158055:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a81646c4000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788836621.158060:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 647 00000100:00080000:2.0:1788836621.158065:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788836621.158071:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a81646c4000 using connection 192.168.201.144@tcp/0@lo 00000100:00100000:2.0:1788836621.158092:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a817f537b80 x1875730518761344/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788836621.158104:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788836621.158108:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788836621.158109:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a815f7e7000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788836621.158112:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 642 00000100:00080000:2.0:1788836621.158115:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788836621.158125:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a815f7e7000 using connection 192.168.201.144@tcp/0@lo 00000100:00100000:2.0:1788836621.158138:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a817f535f80 x1875730518761472/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788836621.158159:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788836621.158162:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788836621.158164:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a8158dbd800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788836621.158167:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 642 00000100:00080000:2.0:1788836621.158169:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788836621.158172:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a8158dbd800 using connection 192.168.201.144@tcp/0@lo 00000100:00100000:2.0:1788836621.158183:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a817f535180 x1875730518761600/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788836621.158217:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f534700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875730518761728:0@lo:400:kworker.0 00000100:00100000:2.0:1788836621.158279:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836621.158324:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788836621.158331:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f534000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d9f3bec-9812-4f3e-be22-5440158bfa78:3619:1875730518761216:0@lo:400:kworker.0 00000100:00100000:2.0:1788836621.158358:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836621.158404:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518761728 00000100:00100000:2.0:1788836621.158411:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518761728 00000100:00100000:2.0:1788836621.158453:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788836621.158550:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f536a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875730518761728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836621.158605:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f536a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875730518761728:12345-0@lo:400:kworker.0 Request processed in 143us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836621.158613:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788836621.158636:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518761216 00000100:00100000:2.0:1788836621.158640:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518761216 00000100:00100000:2.0:1788836621.158712:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788836621.158727:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f416050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+12:3619:x1875730518761216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836621.158758:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f416050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+12:3619:x1875730518761216:12345-0@lo:400:kworker.0 Request processed in 33us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836621.158764:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788836621.158805:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f534000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d9f3bec-9812-4f3e-be22-5440158bfa78:3619:1875730518761216:0@lo:400:kworker.0 00010000:00080000:2.0:1788836621.158818:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a817f534700 x1875730518761728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836621.158827:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f534700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875730518761728:0@lo:400:kworker.0 00000100:00100000:1.0:1788836621.158895:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f537b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875730518761344:0@lo:38:kworker.0 00000100:00100000:1.0:1788836621.158933:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836621.158962:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f535f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875730518761472:0@lo:8:kworker.0 00000400:00000100:1.0:1788836621.158983:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875730518761472 offset 0 length 520: 4 00000100:00100000:1.0:1788836621.159000:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f535180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875730518761600:0@lo:8:kworker.0 00000400:00000100:1.0:1788836621.159016:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875730518761600 offset 0 length 520: 4 00000100:00100000:2.0:1788836621.159308:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518761344 00000100:00100000:2.0:1788836621.159313:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518761344 00000100:00100000:2.0:1788836621.160225:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788836621.160241:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8172d97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3617:x1875730518761344:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788836621.160257:0:22761:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788836621.160311:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8172d97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3617:x1875730518761344:12345-0@lo:38:kworker.0 Request processed in 70us (1378us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788836621.160317:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788836621.160679:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9a81646c4000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788836621.160685:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788836621.160688:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f537b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875730518761344:0@lo:38:kworker.0 00000100:00100000:1.0:1788836621.350711:0:22797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8179dd8300 going to sleep for 0 seconds 00010000:00010000:0.0:1788836621.989587:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836622.373519:0:22797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8179dd8300 going to sleep for 0 seconds 00010000:00010000:0.0:1788836623.018016:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836623.398348:0:22797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8179dd8300 going to sleep for 0 seconds 00010000:00010000:0.0:1788836624.037692:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788836624.358095:0:22791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788836624.421963:0:22797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8179dd8300 going to sleep for 0 seconds 00010000:00010000:0.0:1788836625.061623:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836625.445702:0:22797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8179dd8300 going to sleep for 0 seconds 00010000:00010000:0.0:1788836626.085571:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788836626.277724:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788836626.277732:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788836626.277736:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a81646c4000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788836626.277745:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 651 00000100:00080000:2.0:1788836626.277752:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788836626.277760:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a81646c4000 using connection 192.168.201.144@tcp/0@lo 00000100:00100000:2.0:1788836626.277789:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a817f534000 x1875730518761984/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788836626.277832:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788836626.277836:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788836626.277839:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788836626.277842:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788836626.277930:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f534000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875730518761984:0@lo:38:kworker.0 00000100:00100000:2.0:1788836626.278032:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836626.278115:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518761984 00000100:00100000:2.0:1788836626.278122:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518761984 00000100:00100000:2.0:1788836626.278156:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788836626.278163:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f534380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3617:x1875730518761984:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788836626.278183:0:22760:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788836626.278393:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f534700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d9f3bec-9812-4f3e-be22-5440158bfa78:3620:1875730518761856:0@lo:400:kworker.0 00000100:00100000:3.0:1788836626.278441:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836626.278492:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788836626.278498:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f537b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875730518762112:0@lo:400:kworker.0 00000100:00100000:3.0:1788836626.278526:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836626.278554:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518761856 00000100:00100000:3.0:1788836626.278558:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518761856 00000100:00100000:3.0:1788836626.278595:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788836626.278602:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f416850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+12:3620:x1875730518761856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836626.278652:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f416850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+12:3620:x1875730518761856:12345-0@lo:400:kworker.0 Request processed in 50us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836626.278660:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788836626.278715:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518762112 00000100:00100000:3.0:1788836626.278719:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518762112 00000100:00100000:3.0:1788836626.278763:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788836626.278769:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81412e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875730518762112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836626.278804:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81412e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875730518762112:12345-0@lo:400:kworker.0 Request processed in 35us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836626.278810:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788836626.278851:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a817f537b80 x1875730518762112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836626.278866:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f537b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875730518762112:0@lo:400:kworker.0 00000100:00100000:3.0:1788836626.278878:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f534700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d9f3bec-9812-4f3e-be22-5440158bfa78:3620:1875730518761856:0@lo:400:kworker.0 00000100:00100000:2.0:1788836626.279651:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f534380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3617:x1875730518761984:12345-0@lo:38:kworker.0 Request processed in 1484us (1616us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788836626.279660:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788836626.279799:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9a81646c4000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788836626.279805:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788836626.279808:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f534000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875730518761984:0@lo:38:kworker.0 00000100:00100000:1.0:1788836626.469536:0:22797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8179dd8300 going to sleep for 0 seconds 00000020:01000004:2.0:1788836626.789291:0:23489:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788836626.789296:0:23489:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788836626.789298:0:23489:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788836626.789443:0:23489:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a80471cd800 00000020:01000004:2.0:1788836626.789482:0:23489:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1788836626.789494:0:23489:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788836626.789510:0:23489:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9a8164233370) 00000020:00000080:2.0:1788836626.789529:0:23489:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788836626.860870:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788836626.861444:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1788836626.866737:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788836626.867301:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788836626.867584:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788836626.867769:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788836626.867975:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788836626.868289:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1788836626.868531:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788836626.868740:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788836626.868935:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788836626.870145:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788836626.870519:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1788836626.870740:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1788836626.871284:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1788836626.871516:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788836626.871725:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1788836626.871900:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788836626.872450:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788836626.872755:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788836626.872967:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1788836626.873232:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788836626.873587:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1788836626.873774:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1788836626.874081:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788836626.874381:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788836626.874616:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1788836626.874815:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788836626.875214:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1788836626.875493:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788836626.875730:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1788836626.875934:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788836626.876198:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788836626.876392:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788836626.876585:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788836626.876746:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788836626.876937:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788836626.877432:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1788836626.877688:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788836626.877817:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788836626.878067:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788836626.878812:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1788836626.880240:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788836626.880653:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788836626.881350:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1788836626.881681:0:23489:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00080000:01000000:2.0:1788836626.882427:0:23489:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788836626.882703:0:23489:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1788836626.882714:0:23489:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788836626.882723:0:23489:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xbd163c737571609d 00000020:01000004:2.0:1788836626.882730:0:23489:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788836626.882751:0:23489:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.144@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788836626.882754:0:23489:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.144@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788836626.882760:0:23489:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1788836626.882785:0:23489:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1788836626.882788:0:23489:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.144@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1788836626.891575:0:23489:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.144@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788836626.891615:0:23489:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.201.144@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1788836626.891621:0:23489:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788836626.891623:0:23489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788836626.891624:0:23489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788836626.891625:0:23489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788836626.891626:0:23489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788836626.891627:0:23489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788836626.891628:0:23489:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788836626.891630:0:23489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788836626.891631:0:23489:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788836626.891634:0:23489:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1788836626.891635:0:23489:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788836626.891637:0:23489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788836626.891638:0:23489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788836626.891638:0:23489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788836626.891639:0:23489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788836626.891640:0:23489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788836626.891641:0:23489:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788836626.891642:0:23489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788836626.891643:0:23489:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788836626.891665:0:23489:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788836626.891683:0:23489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f536d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:23489:1875730518762240:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788836626.891744:0:23489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836626.891787:0:23489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8047620f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788836626.892075:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518762240 00000100:00100000:3.0:1788836626.892084:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518762240 00000100:00100000:3.0:1788836626.892320:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788836626.892330:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f415050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+12:23489:x1875730518762240:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788836626.892409:0:22748:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788836626.892413:0:22748:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1788836626.892421:0:22748:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788836626.892820:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f415050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+12:23489:x1875730518762240:12345-0@lo:253:mount.lustre.0 Request processed in 491us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836626.892829:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788836626.892929:0:23489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f536d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:23489:1875730518762240:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788836626.892940:0:23489:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788836626.892952:0:23489:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788836626.892960:0:23489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788836626.892961:0:23489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788836626.892962:0:23489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788836626.892963:0:23489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788836626.892964:0:23489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788836626.892966:0:23489:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788836626.892967:0:23489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788836626.892969:0:23489:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788836626.892988:0:23489:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a80471cd800 from lustre-MDT0001 10000000:01000000:2.0:1788836626.893013:0:23489:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1788836626.893016:0:23489:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788836626.893029:0:23489:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a815f6019b8 local copy 00010000:00010000:2.0:1788836626.893039:0:23489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a817f41a000/0xbd163c7375715f93 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375715f9a expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836626.893157:0:23489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f536d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:23489:1875730518762368:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788836626.893186:0:23489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836626.894579:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518762368 00000100:00100000:0.0:1788836626.894587:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518762368 00000100:00100000:0.0:1788836626.894626:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788836626.894634:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81446a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+12:23489:x1875730518762368:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788836626.894710:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81446a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+12:23489:x1875730518762368:12345-0@lo:501:mount.lustre.0 Request processed in 76us (1522us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788836626.894717:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788836626.894773:0:23489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8047620c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788836626.894791:0:23489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f536d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:23489:1875730518762368:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788836626.894809:0:23489:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.144@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788836626.894831:0:23489:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.144@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788836626.894846:0:23489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a817f41a000/0xbd163c7375715f93 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375715f9a expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836626.894855:0:23489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.144@tcp lock: ffff9a817f41a000/0xbd163c7375715f93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375715f9a expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836626.894896:0:23489:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a80471cd800 10000000:01000000:0.0:1788836626.894902:0:23489:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788836626.894907:0:23489:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9a815f6019b8 10000000:01000000:0.0:1788836626.894910:0:23489:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788836626.894914:0:23489:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9a815f6019b8 from 1 10000000:01000000:0.0:1788836626.894917:0:23489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788836626.894944:0:23489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a804738ca00/0xbd163c73757160a4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836626.894952:0:23489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.144@tcp lock: ffff9a804738ca00/0xbd163c73757160a4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836626.895094:0:23489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.144@tcp lock: ffff9a804738ca00/0xbd163c73757160a4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836626.895114:0:23489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd74380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:23489:1875730518762496:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788836626.895148:0:23489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836626.895175:0:23489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8150ea6000 going to sleep for 11 seconds 00000100:00100000:2.0:1788836626.895364:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518762496 00000100:00100000:2.0:1788836626.895369:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518762496 00000100:00100000:1.0:1788836626.895406:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788836626.895416:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81446a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+12:23489:x1875730518762496:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788836626.895426:0:22750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836626.895438:0:22750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a817f41b800/0xbd163c73757160ab lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd163c73757160a4 expref: -99 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836626.895490:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a817f41b800/0xbd163c73757160ab lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd163c73757160a4 expref: 13 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836626.895559:0:22750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a817f41b800/0xbd163c73757160ab lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd163c73757160a4 expref: 13 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836626.895570:0:22750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a817f41b800, rc 0) 00000100:00100000:1.0:1788836626.895656:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81446a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+13:23489:x1875730518762496:12345-0@lo:101:mount.lustre.0 Request processed in 241us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836626.895663:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788836626.895721:0:23489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd74380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:23489:1875730518762496:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788836626.895733:0:23489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.144@tcp lock: ffff9a804738ca00/0xbd163c73757160a4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c73757160ab expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836626.895741:0:23489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.144@tcp lock: ffff9a804738ca00/0xbd163c73757160a4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd163c73757160ab expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836626.895763:0:23489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.144@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788836626.895781:0:23489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a804738ca00/0xbd163c73757160a4 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c73757160ab expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836626.895788:0:23489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.144@tcp lock: ffff9a804738ca00/0xbd163c73757160a4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c73757160ab expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836626.895795:0:23489:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9a80471cd800 10000000:01000000:0.0:1788836626.895799:0:23489:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788836626.895802:0:23489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9a80471cd800 from 1 10000000:01000000:0.0:1788836626.895804:0:23489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788836626.895821:0:23489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a804738c200/0xbd163c73757160b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836626.895829:0:23489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.144@tcp lock: ffff9a804738c200/0xbd163c73757160b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836626.895837:0:23489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.144@tcp lock: ffff9a804738c200/0xbd163c73757160b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836626.895850:0:23489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd74380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:23489:1875730518762624:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788836626.895875:0:23489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836626.895903:0:23489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8150ea6000 going to sleep for 11 seconds 00000100:00100000:2.0:1788836626.896091:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518762624 00000100:00100000:2.0:1788836626.896096:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518762624 00000100:00100000:2.0:1788836626.896136:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788836626.896143:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81446a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+13:23489:x1875730518762624:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788836626.896151:0:22749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836626.896160:0:22749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8167975000/0xbd163c73757160b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd163c73757160b2 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836626.896175:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8167975000/0xbd163c73757160b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd163c73757160b2 expref: 14 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836626.896183:0:22749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8167975000/0xbd163c73757160b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd163c73757160b2 expref: 14 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836626.896190:0:22749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8167975000, rc 0) 00000100:00100000:2.0:1788836626.896229:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81446a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+14:23489:x1875730518762624:12345-0@lo:101:mount.lustre.0 Request processed in 87us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836626.896235:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788836626.896588:0:23489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd74380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:23489:1875730518762624:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788836626.896601:0:23489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.144@tcp lock: ffff9a804738c200/0xbd163c73757160b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c73757160b9 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836626.896610:0:23489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.144@tcp lock: ffff9a804738c200/0xbd163c73757160b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd163c73757160b9 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836626.896631:0:23489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.144@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788836626.896646:0:23489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a804738c200/0xbd163c73757160b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c73757160b9 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836626.896653:0:23489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.144@tcp lock: ffff9a804738c200/0xbd163c73757160b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c73757160b9 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836626.896660:0:23489:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788836626.896664:0:23489:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788836626.896669:0:23489:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9a80471cd800 10000000:01000000:0.0:1788836626.896671:0:23489:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788836626.896674:0:23489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1788836626.896676:0:23489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788836626.896691:0:23489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a804738d200/0xbd163c73757160c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836626.896698:0:23489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.144@tcp lock: ffff9a804738d200/0xbd163c73757160c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836626.896705:0:23489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.144@tcp lock: ffff9a804738d200/0xbd163c73757160c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836626.896719:0:23489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd74380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:23489:1875730518762752:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788836626.896747:0:23489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836626.896779:0:23489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8150ea6000 going to sleep for 11 seconds 00000100:00100000:1.0:1788836626.896882:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518762752 00000100:00100000:1.0:1788836626.896886:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518762752 00000100:00100000:1.0:1788836626.896914:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788836626.896921:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81446a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+14:23489:x1875730518762752:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788836626.896928:0:22750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836626.896937:0:22750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a817f41a200/0xbd163c73757160c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd163c73757160c0 expref: -99 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836626.896967:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a817f41a200/0xbd163c73757160c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd163c73757160c0 expref: 15 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836626.896975:0:22750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a817f41a200/0xbd163c73757160c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd163c73757160c0 expref: 15 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836626.896982:0:22750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a817f41a200, rc 0) 00000100:00100000:1.0:1788836626.897019:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81446a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+15:23489:x1875730518762752:12345-0@lo:101:mount.lustre.0 Request processed in 99us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836626.897023:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788836626.897203:0:23489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd74380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:23489:1875730518762752:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788836626.897214:0:23489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.144@tcp lock: ffff9a804738d200/0xbd163c73757160c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c73757160c7 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836626.897232:0:23489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.144@tcp lock: ffff9a804738d200/0xbd163c73757160c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd163c73757160c7 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788836626.899197:0:23489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:3.0:1788836626.901446:0:23489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788836626.910055:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1788836626.910189:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:3.0:1788836626.910209:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:3.0:1788836626.910225:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:3.0:1788836626.910239:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:3.0:1788836626.910318:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:3.0:1788836626.910337:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:3.0:1788836626.910351:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:3.0:1788836626.910363:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:3.0:1788836626.910380:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:3.0:1788836626.910394:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:3.0:1788836626.910409:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:3.0:1788836626.910423:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:3.0:1788836626.910436:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:3.0:1788836626.910448:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:3.0:1788836626.910484:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:3.0:1788836626.910503:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:3.0:1788836626.910520:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:3.0:1788836626.910535:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:3.0:1788836626.910548:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:3.0:1788836626.910561:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:3.0:1788836626.910574:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:3.0:1788836626.910587:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:3.0:1788836626.910600:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:3.0:1788836626.910615:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:3.0:1788836626.910630:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:3.0:1788836626.910654:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:3.0:1788836626.910667:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:3.0:1788836626.910680:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:3.0:1788836626.910694:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:3.0:1788836626.910707:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:3.0:1788836626.910724:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:3.0:1788836626.910741:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:3.0:1788836626.910756:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:3.0:1788836626.910768:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:3.0:1788836626.910780:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:3.0:1788836626.910793:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:3.0:1788836626.910805:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:3.0:1788836626.910819:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:3.0:1788836626.910833:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:3.0:1788836626.910848:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:3.0:1788836626.910861:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:3.0:1788836626.911386:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:3.0:1788836626.911410:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:3.0:1788836626.911442:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:3.0:1788836626.911449:0:23489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:0.0:1788836626.911769:0:23489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd77b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:23489:1875730518762880:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788836626.911838:0:23489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836626.913225:0:23489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8150ea6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788836626.913360:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518762880 00000100:00100000:3.0:1788836626.913368:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518762880 00000100:00100000:3.0:1788836626.913736:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788836626.913748:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81446a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+15:23489:x1875730518762880:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788836626.913957:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81446a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+15:23489:x1875730518762880:12345-0@lo:501:mount.lustre.0 Request processed in 211us (2117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836626.913965:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788836626.914065:0:23489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd77b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:23489:1875730518762880:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788836626.914113:0:23489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd77b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:23489:1875730518763008:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788836626.914166:0:23489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836626.914316:0:23489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8150ea6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788836626.914483:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518763008 00000100:00100000:1.0:1788836626.914489:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518763008 00000100:00100000:1.0:1788836626.914526:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788836626.914534:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81446a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+15:23489:x1875730518763008:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788836626.915374:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81446a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+15:23489:x1875730518763008:12345-0@lo:503:mount.lustre.0 Request processed in 837us (1204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836626.915382:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788836626.915404:0:23489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd77b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:23489:1875730518763008:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788836626.916404:0:23489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788836626.916666:0:23489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd77b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:23489:1875730518763136:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788836626.916736:0:23489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836626.916779:0:23489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8150ea6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788836626.917343:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518763136 00000100:00100000:3.0:1788836626.917350:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518763136 00000100:00100000:3.0:1788836626.917408:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788836626.917418:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81446a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+15:23489:x1875730518763136:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788836626.920318:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81446a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+15:23489:x1875730518763136:12345-0@lo:502:mount.lustre.0 Request processed in 2891us (3572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836626.920333:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788836626.920348:0:23489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd77b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:23489:1875730518763136:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788836626.920841:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1788836626.920880:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:0.0:1788836626.920896:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:0.0:1788836626.920911:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:0.0:1788836626.920926:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:0.0:1788836626.920938:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:0.0:1788836626.920950:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:0.0:1788836626.920963:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:0.0:1788836626.920976:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:0.0:1788836626.920989:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:0.0:1788836626.921002:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:0.0:1788836626.921016:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:0.0:1788836626.921037:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:0.0:1788836626.921073:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:0.0:1788836626.921085:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:0.0:1788836626.921097:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:0.0:1788836626.921109:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:0.0:1788836626.921132:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:0.0:1788836626.921145:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:0.0:1788836626.921157:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:0.0:1788836626.921170:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:0.0:1788836626.921183:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:0.0:1788836626.921198:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:0.0:1788836626.921210:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:0.0:1788836626.921224:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:0.0:1788836626.921236:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:0.0:1788836626.921250:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:0.0:1788836626.921263:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:0.0:1788836626.921276:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:0.0:1788836626.921288:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:0.0:1788836626.921300:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:0.0:1788836626.921311:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:0.0:1788836626.921323:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:0.0:1788836626.921334:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:0.0:1788836626.921346:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:0.0:1788836626.921358:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:0.0:1788836626.921369:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:0.0:1788836626.921381:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:0.0:1788836626.922374:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:0.0:1788836626.922586:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:0.0:1788836626.922607:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:0.0:1788836626.922621:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:0.0:1788836626.922636:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:0.0:1788836626.922650:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:0.0:1788836626.922700:0:23489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd77b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:23489:1875730518763264:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788836626.922788:0:23489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836626.922898:0:23489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8150ea6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788836626.923054:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518763264 00000100:00100000:1.0:1788836626.923062:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518763264 00000100:00100000:1.0:1788836626.923223:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788836626.923233:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81446a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+15:23489:x1875730518763264:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788836626.923382:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81446a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+15:23489:x1875730518763264:12345-0@lo:502:mount.lustre.0 Request processed in 149us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836626.923398:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788836626.923523:0:23489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd77b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:23489:1875730518763264:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788836626.923579:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:0.0:1788836626.923587:0:23489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1788836626.924223:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788836626.924234:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836626.924236:0:23493:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788836626.924242:0:23493:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1788836626.924245:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788836626.924264:0:23493:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9a817f3f99b8) 00000020:00000080:0.0:1788836626.924287:0:23493:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1788836626.924293:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788836626.924440:0:23493:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788836626.924449:0:23493:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xbd163c73757160d5 00000020:00000080:0.0:1788836626.924668:0:23493:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1788836626.924672:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788836626.924674:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836626.924675:0:23493:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788836626.924677:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788836626.924679:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836626.924680:0:23493:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1788836626.924682:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788836626.924687:0:23493:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9a817f3fcd28) 00000020:00000080:0.0:1788836626.924695:0:23493:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:0.0:1788836626.924697:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788836626.924699:0:23493:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1788836626.924701:0:23493:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1788836626.924704:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788836626.924745:0:23493:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a80471cd800 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1788836626.924755:0:23493:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9a817f3fb370) 00000020:00000080:0.0:1788836626.924760:0:23493:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1788836626.924798:0:23493:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788836626.924801:0:23493:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xbd163c73757160ea 00000020:00000080:0.0:1788836626.924861:0:23493:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1788836626.924870:0:23493:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788836626.924873:0:23493:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xbd163c73757160f1 00080000:01000000:0.0:1788836626.924878:0:23493:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788836626.924881:0:23493:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xbd163c73757160f8 00010000:00010000:0.0:1788836626.976101:0:23493:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:0.0:1788836626.976908:0:23493:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:0.0:1788836626.977688:0:23493:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788836626.978973:0:23493:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1788836626.978997:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788836626.979006:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836626.979009:0:23493:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1788836626.979012:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788836626.979021:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836626.979022:0:23493:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1788836626.979025:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788836626.979035:0:23493:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.144@tcp to nid 0x20000c0a8c990 (192.168.201.144@tcp) 00000020:00000080:0.0:1788836626.979099:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788836626.979126:0:23493:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9a817f4db370) 00000020:00000080:0.0:1788836626.979163:0:23493:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:0.0:1788836626.979168:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788836626.979270:0:23493:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1788836626.979278:0:23493:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788836626.979287:0:23493:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xbd163c7375716106 00010000:00080000:0.0:1788836626.979346:0:23493:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a816d434800@lustre-MDT0000-osp-MDT0001: add connection 192.168.201.144@tcp at head 00010000:00010000:0.0:1788836626.981352:0:23493:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1788836626.983557:0:23493:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788836626.983583:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788836626.983646:0:23493:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788836626.983689:0:23493:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xbd163c737571610d 00000100:00080000:0.0:1788836626.983713:0:23493:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788836626.983724:0:23493:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9a816d434800 using connection 192.168.201.144@tcp/0@lo 00000100:00100000:0.0:1788836626.983800:0:23493:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a816bd77b80 x1875730518763392/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788836626.983837:0:23493:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1788836626.983912:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788836626.983918:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836626.983920:0:23493:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1788836626.983924:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788836626.983927:0:23493:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788836626.983929:0:23493:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788836626.983931:0:23493:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788836626.983932:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788836626.983935:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836626.983937:0:23493:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788836626.983940:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788836626.983946:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836626.983948:0:23493:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1788836626.983952:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788836626.983991:0:23493:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788836626.984006:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788836626.984010:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836626.984012:0:23493:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1788836626.984014:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788836626.984016:0:23493:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1788836626.984017:0:23493:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788836626.984019:0:23493:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788836626.984020:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788836626.984022:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836626.984023:0:23493:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788836626.984025:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788836626.984028:0:23493:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788836626.984032:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836626.984034:0:23493:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788836626.984037:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788836626.984071:0:23493:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.144@tcp to nid 0x20000c0a8c990 (192.168.201.144@tcp) 00000020:01000000:0.0:1788836626.984107:0:23493:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788836626.984110:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788836626.984129:0:23493:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9a817f4dcd28) 00000020:00000080:0.0:1788836626.984145:0:23493:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1788836626.984150:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788836626.984239:0:23493:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1788836626.984248:0:23493:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788836626.984256:0:23493:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xbd163c737571611b 00010000:00080000:0.0:1788836626.984313:0:23493:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a8181a72800@lustre-OST0000-osc-MDT0001: add connection 192.168.201.144@tcp at head 00000100:00100000:3.0:1788836626.984373:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875730518763392:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788836626.984520:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788836626.984631:0:16590:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788836626.984636:0:16590:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788836626.984639:0:16590:0:(import.c:65:import_set_state_nolock()) ffff9a81646c4000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788836626.984644:0:16590:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 656 00000100:00080000:3.0:1788836626.984649:0:16590:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00010000:00010000:0.0:1788836626.984652:0:23493:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:3.0:1788836626.984654:0:16590:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a81646c4000 using connection 192.168.201.144@tcp/0@lo 00000100:00100000:3.0:1788836626.984669:0:16590:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a81412ea680 x1875730518763648/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788836626.984684:0:16590:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788836626.984687:0:16590:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788836626.984691:0:16590:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788836626.984694:0:16590:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788836626.984725:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518763392 00000100:00100000:3.0:1788836626.984733:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518763392 00000100:00100000:3.0:1788836626.984766:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788836626.984777:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81412ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3617:x1875730518763392:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788836626.984811:0:22760:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 657 last 0 00000020:00000080:3.0:1788836626.984853:0:22760:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xbd163c7375716122 00000040:01000000:0.0:1788836626.985590:0:23493:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788836626.985780:0:23493:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000004:00100000:3.0:1788836626.986547:0:22760:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788836626.986568:0:22760:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:3.0:1788836626.986668:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a81412e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d9f3bec-9812-4f3e-be22-5440158bfa78:3618:1875730518763520:0@lo:400:kworker.0 00000100:00100000:3.0:1788836626.986783:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836626.986858:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788836626.986866:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a81412eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875730518763776:0@lo:400:kworker.0 00000100:00100000:3.0:1788836626.986919:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836626.986974:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518763776 00000100:00100000:3.0:1788836626.986985:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518763776 00000100:00100000:3.0:1788836626.987055:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788836626.987066:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81412e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875730518763776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836626.987142:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81412e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875730518763776:12345-0@lo:400:kworker.0 Request processed in 77us (221us total) trans 0 rc 0/0 00000040:00080000:0.0:1788836626.987145:0:23493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788836626.987150:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788836626.987189:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a81412ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875730518763648:0@lo:38:kworker.0 00000100:00100000:3.0:1788836626.987221:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836626.987266:0:22761:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1788836626.987275:0:22761:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000040:00080000:0.0:1788836626.987346:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00010000:00080000:3.0:1788836626.987520:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a81412eb100 x1875730518763776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836626.987539:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a81412eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875730518763776:0@lo:400:kworker.0 00000100:00100000:3.0:1788836626.987572:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518763520 00000100:00100000:3.0:1788836626.987577:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518763520 00000040:00080000:0.0:1788836626.987581:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:3.0:1788836626.987614:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788836626.987623:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81446a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+15:3618:x1875730518763520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836626.987668:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81446a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+15:3618:x1875730518763520:12345-0@lo:400:kworker.0 Request processed in 46us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836626.987685:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788836626.987701:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a81412e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d9f3bec-9812-4f3e-be22-5440158bfa78:3618:1875730518763520:0@lo:400:kworker.0 00000100:00100000:3.0:1788836626.987800:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518763648 00000100:00100000:3.0:1788836626.987805:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518763648 00000040:00080000:0.0:1788836626.987937:0:23499:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788836626.987943:0:23499:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000100:00100000:3.0:1788836626.987979:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788836626.987985:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81412ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3617:x1875730518763648:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788836626.988056:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81412ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3617:x1875730518763648:12345-0@lo:38:kworker.0 Request processed in 70us (834us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788836626.988063:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788836626.988121:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788836626.988133:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9a81646c4000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788836626.988140:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788836626.988144:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a81412ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875730518763648:0@lo:38:kworker.0 00000020:00000080:3.0:1788836626.990350:0:23493:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788836626.990368:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788836626.990427:0:23493:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788836626.990452:0:23493:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xbd163c7375716129 00000100:00080000:3.0:1788836626.990494:0:23493:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788836626.990501:0:23493:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9a8181a72800 using connection 192.168.201.144@tcp/0@lo 00000100:00100000:3.0:1788836626.990537:0:23493:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a81412eb100 x1875730518763904/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788836626.990562:0:23493:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788836626.990596:0:16590:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788836626.990600:0:16590:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788836626.990604:0:16590:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788836626.990606:0:16590:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:3.0:1788836626.990673:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788836626.990678:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836626.990679:0:23493:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788836626.990683:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788836626.990686:0:23493:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1788836626.990696:0:23493:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788836626.990699:0:23493:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788836626.990700:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788836626.990704:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836626.990705:0:23493:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788836626.990708:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788836626.990713:0:23493:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788836626.990716:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788836626.990717:0:23493:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788836626.990720:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788836626.990724:0:23493:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.144@tcp to nid 0x20000c0a8c990 (192.168.201.144@tcp) 00000020:01000000:3.0:1788836626.990753:0:23493:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788836626.990756:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788836626.990768:0:23493:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9a816c10b370) 00000020:00000080:3.0:1788836626.990780:0:23493:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1788836626.990785:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788836626.990862:0:23493:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1788836626.990869:0:23493:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788836626.990877:0:23493:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xbd163c7375716137 00010000:00080000:3.0:1788836626.990910:0:23493:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a80475ef000@lustre-OST0001-osc-MDT0001: add connection 192.168.201.144@tcp at head 00010000:00010000:3.0:1788836626.991137:0:23493:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1788836626.991212:0:23493:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788836626.991230:0:23493:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:0.0:1788836626.991516:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a81412eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875730518763904:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788836626.991572:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875730518763904 offset 0 length 520: 4 00000100:00080000:3.0:1788836626.994342:0:22760:0:(import.c:65:import_set_state_nolock()) ffff9a80475e8800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788836626.994583:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81412ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3617:x1875730518763392:12345-0@lo:38:llog_process_th.0 Request processed in 9804us (10061us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836626.994595:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:0.0:1788836626.994856:0:23493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788836626.997587:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:0.0:1788836626.997809:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000100:00100000:1.0:1788836627.000447:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788836627.000552:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1788836627.000562:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788836627.000568:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788836627.000572:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9a816d434800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788836627.000592:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875730518763392:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788836627.001192:0:23501:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788836627.001197:0:23501:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788836627.001905:0:23493:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788836627.001918:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788836627.001960:0:23493:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788836627.001984:0:23493:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xbd163c737571613e 00000100:00080000:1.0:1788836627.001992:0:23493:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788836627.001997:0:23493:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a80475ef000 using connection 192.168.201.144@tcp/0@lo 00000100:00100000:1.0:1788836627.002022:0:23493:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8172d96300 x1875730518764160/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788836627.002075:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875730518764160:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788836627.002139:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875730518764160 offset 0 length 520: 4 00000100:00080000:1.0:1788836627.002187:0:23493:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788836627.002262:0:16590:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788836627.002267:0:16590:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788836627.002275:0:16590:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788836627.002278:0:16590:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:1.0:1788836627.002338:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788836627.002343:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836627.002345:0:23493:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788836627.002348:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788836627.002352:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836627.002353:0:23493:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788836627.002356:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788836627.002357:0:23493:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788836627.002360:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788836627.002362:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836627.002363:0:23493:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788836627.002365:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788836627.002368:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836627.002369:0:23493:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788836627.002372:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788836627.002410:0:23493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788836627.002414:0:23493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788836627.002416:0:23493:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788836627.002419:0:23493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000020:01000000:1.0:1788836627.002509:0:23489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:1.0:1788836627.002538:0:23489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.144@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788836627.002554:0:23489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a804738d200/0xbd163c73757160c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c73757160c7 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836627.002565:0:23489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.144@tcp lock: ffff9a804738d200/0xbd163c73757160c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c73757160c7 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836627.002585:0:23489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a80471cd800 from 1 10000000:01000000:1.0:1788836627.002588:0:23489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788836627.002612:0:23489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a817f41b400/0xbd163c7375716145 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836627.002619:0:23489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.144@tcp lock: ffff9a817f41b400/0xbd163c7375716145 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836627.002629:0:23489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.144@tcp lock: ffff9a817f41b400/0xbd163c7375716145 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836627.002644:0:23489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d94380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:23489:1875730518764288:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788836627.002682:0:23489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836627.002707:0:23489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8041438540 going to sleep for 11 seconds 00000100:00100000:3.0:1788836627.002839:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518764288 00000100:00100000:3.0:1788836627.002847:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518764288 00000100:00100000:3.0:1788836627.002890:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788836627.002899:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81446a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+15:23489:x1875730518764288:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788836627.002914:0:22750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836627.002925:0:22750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a80462e7e00/0xbd163c737571614c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd163c7375716145 expref: -99 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836627.002949:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a80462e7e00/0xbd163c737571614c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd163c7375716145 expref: 16 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836627.002960:0:22750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a80462e7e00/0xbd163c737571614c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd163c7375716145 expref: 16 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836627.002969:0:22750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a80462e7e00, rc 0) 00000100:00100000:3.0:1788836627.003015:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81446a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+16:23489:x1875730518764288:12345-0@lo:101:mount.lustre.0 Request processed in 116us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836627.003022:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788836627.003113:0:23489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d94380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:23489:1875730518764288:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788836627.003125:0:23489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.144@tcp lock: ffff9a817f41b400/0xbd163c7375716145 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c737571614c expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836627.003134:0:23489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.144@tcp lock: ffff9a817f41b400/0xbd163c7375716145 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd163c737571614c expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836627.003706:0:23489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d94380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:23489:1875730518764416:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788836627.003747:0:23489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836627.003815:0:23489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8041438540 going to sleep for 11 seconds 00000100:00100000:0.0:1788836627.003971:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788836627.003986:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875730518764032:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788836627.004025:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836627.004162:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518764416 00000100:00100000:3.0:1788836627.004167:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518764416 00000100:00100000:3.0:1788836627.004238:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788836627.004248:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81446a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+16:23489:x1875730518764416:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788836627.004266:0:22749:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788836627.004283:0:22749:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788836627.004286:0:22749:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:3.0:1788836627.004378:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81446a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+16:23489:x1875730518764416:12345-0@lo:256:mount.lustre.0 Request processed in 130us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836627.004403:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788836627.004494:0:23489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d94380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:23489:1875730518764416:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788836627.005084:0:23489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788836627.005102:0:23489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a817f41b400/0xbd163c7375716145 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c737571614c expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836627.005113:0:23489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.144@tcp lock: ffff9a817f41b400/0xbd163c7375716145 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c737571614c expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836627.005121:0:23489:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a80471cd800 from 1 10000000:01000000:0.0:1788836627.005125:0:23489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788836627.005154:0:23489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a804738dc00/0xbd163c7375716153 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836627.005162:0:23489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.144@tcp lock: ffff9a804738dc00/0xbd163c7375716153 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836627.005171:0:23489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.144@tcp lock: ffff9a804738dc00/0xbd163c7375716153 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836627.005186:0:23489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd77b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:23489:1875730518764544:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788836627.005221:0:23489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836627.005659:0:23489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a804640d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836627.005709:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518764544 00000100:00100000:1.0:1788836627.005716:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518764544 00000100:00100000:1.0:1788836627.005751:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788836627.005771:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81446a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+16:23489:x1875730518764544:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788836627.005785:0:22750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836627.005797:0:22750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a817f41aa00/0xbd163c737571615a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd163c7375716153 expref: -99 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836627.005818:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a817f41aa00/0xbd163c737571615a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd163c7375716153 expref: 17 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836627.005828:0:22750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a817f41aa00/0xbd163c737571615a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd163c7375716153 expref: 17 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836627.005836:0:22750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a817f41aa00, rc 0) 00000100:00100000:1.0:1788836627.005913:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81446a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+17:23489:x1875730518764544:12345-0@lo:101:mount.lustre.0 Request processed in 143us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836627.005920:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788836627.005996:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518764032 00000100:00100000:3.0:1788836627.006001:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518764032 00000100:00100000:3.0:1788836627.006030:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788836627.006036:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a816bd75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3621:x1875730518764032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788836627.006076:0:22761:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788836627.006120:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a816bd75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3621:x1875730518764032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (2094us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836627.006126:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788836627.006174:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875730518764032:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788836627.006223:0:23489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd77b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:23489:1875730518764544:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788836627.006236:0:23489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.144@tcp lock: ffff9a804738dc00/0xbd163c7375716153 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c737571615a expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836627.006256:0:23489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.144@tcp lock: ffff9a804738dc00/0xbd163c7375716153 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd163c737571615a expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788836627.007634:0:23489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:0.0:1788836627.008096:0:23489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788836627.008287:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1788836627.008313:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:0.0:1788836627.008327:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:0.0:1788836627.008340:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:0.0:1788836627.008352:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:0.0:1788836627.008366:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:0.0:1788836627.008377:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:0.0:1788836627.008614:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:0.0:1788836627.008640:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1788836627.008652:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:0.0:1788836627.008664:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:0.0:1788836627.008681:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:0.0:1788836627.008687:0:23489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:0.0:1788836627.008789:0:23489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd77b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:23489:1875730518764672:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788836627.008869:0:23489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836627.008968:0:23489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a804640d240 going to sleep for 11 seconds 00000100:00100000:1.0:1788836627.009016:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518764672 00000100:00100000:1.0:1788836627.009024:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518764672 00000100:00100000:1.0:1788836627.009122:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788836627.009134:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81446a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+17:23489:x1875730518764672:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788836627.009253:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81446a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+17:23489:x1875730518764672:12345-0@lo:501:mount.lustre.0 Request processed in 121us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836627.009261:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788836627.009333:0:23489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd77b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:23489:1875730518764672:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788836627.009366:0:23489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd77b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:23489:1875730518764800:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788836627.009422:0:23489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836627.009742:0:23489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a804640d240 going to sleep for 11 seconds 00000100:00100000:3.0:1788836627.009785:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518764800 00000100:00100000:3.0:1788836627.009790:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518764800 00000100:00100000:3.0:1788836627.009816:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788836627.009822:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81446a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+17:23489:x1875730518764800:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788836627.009944:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81446a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+17:23489:x1875730518764800:12345-0@lo:503:mount.lustre.0 Request processed in 121us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836627.009952:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788836627.010054:0:23489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd77b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:23489:1875730518764800:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788836627.010646:0:23489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788836627.010725:0:23489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd77b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:23489:1875730518764928:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788836627.010767:0:23489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836627.010802:0:23489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a804640d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836627.010854:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518764928 00000100:00100000:3.0:1788836627.010859:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518764928 00000100:00100000:3.0:1788836627.010892:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788836627.010899:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81446a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+17:23489:x1875730518764928:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788836627.010989:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81446a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+17:23489:x1875730518764928:12345-0@lo:502:mount.lustre.0 Request processed in 89us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836627.010997:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788836627.011109:0:23489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd77b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:23489:1875730518764928:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788836627.011287:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1788836627.011313:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:0.0:1788836627.011329:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:0.0:1788836627.011345:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:0.0:1788836627.011361:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:0.0:1788836627.011375:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:0.0:1788836627.011532:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:0.0:1788836627.011555:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:0.0:1788836627.011570:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1788836627.011584:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:0.0:1788836627.011600:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:0.0:1788836627.011624:0:23489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd77b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:23489:1875730518765056:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788836627.011664:0:23489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836627.011693:0:23489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a804640d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836627.011751:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518765056 00000100:00100000:3.0:1788836627.011760:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518765056 00000100:00100000:3.0:1788836627.011791:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788836627.011797:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8147b90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+17:23489:x1875730518765056:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788836627.011883:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8147b90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+17:23489:x1875730518765056:12345-0@lo:502:mount.lustre.0 Request processed in 85us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836627.011889:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788836627.011985:0:23489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd77b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:23489:1875730518765056:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788836627.012020:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:0.0:1788836627.012027:0:23489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788836627.012954:0:23503:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788836627.012965:0:23503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836627.012968:0:23503:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788836627.012974:0:23503:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a80471cd800 00000020:00000080:0.0:1788836627.012978:0:23503:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788836627.012987:0:23503:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788836627.012990:0:23503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836627.012991:0:23503:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788836627.013000:0:23503:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788836627.013002:0:23503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836627.013004:0:23503:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788836627.013007:0:23503:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a80471cd800 00000020:00000080:0.0:1788836627.013009:0:23503:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788836627.013110:0:23503:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788836627.013114:0:23503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836627.013115:0:23503:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788836627.013117:0:23503:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788836627.013120:0:23503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836627.013121:0:23503:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788836627.013125:0:23503:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a80471cd800 00000020:00000080:0.0:1788836627.013127:0:23503:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788836627.019455:0:23503:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788836627.019504:0:23503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836627.019508:0:23503:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788836627.019512:0:23503:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788836627.019517:0:23503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836627.019518:0:23503:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788836627.019523:0:23503:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a80471cd800 00000020:00000080:0.0:1788836627.019525:0:23503:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788836627.019589:0:23503:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788836627.019593:0:23503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836627.019594:0:23503:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788836627.019597:0:23503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:2.0:1788836627.021517:0:23489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788836627.021568:0:23489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788836627.021589:0:23489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a804738dc00/0xbd163c7375716153 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c737571615a expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836627.021611:0:23489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.144@tcp lock: ffff9a804738dc00/0xbd163c7375716153 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c737571615a expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836627.021682:0:23489:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788836627.021685:0:23489:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a80471cd800 10000000:01000000:2.0:1788836627.021688:0:23489:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a80471cd800 10000000:01000000:2.0:1788836627.021693:0:23489:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788836627.021698:0:23489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a80471cd800 from 1 10000000:01000000:2.0:1788836627.021701:0:23489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788836627.021739:0:23489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a8167975c00/0xbd163c7375716161 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836627.021747:0:23489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.144@tcp lock: ffff9a8167975c00/0xbd163c7375716161 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836627.021758:0:23489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.144@tcp lock: ffff9a8167975c00/0xbd163c7375716161 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836627.021784:0:23489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f536300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:23489:1875730518765184:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788836627.021858:0:23489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836627.021908:0:23489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8167bfd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836627.024859:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518765184 00000100:00100000:3.0:1788836627.024876:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518765184 00000100:00100000:3.0:1788836627.025591:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788836627.025605:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8147b91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+17:23489:x1875730518765184:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788836627.025623:0:22749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836627.025644:0:22749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a80462e6800/0xbd163c7375716168 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd163c7375716161 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836627.025675:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a80462e6800/0xbd163c7375716168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd163c7375716161 expref: 18 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836627.025686:0:22749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a80462e6800/0xbd163c7375716168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd163c7375716161 expref: 18 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836627.025695:0:22749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a80462e6800, rc 0) 00000100:00100000:3.0:1788836627.025778:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8147b91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+18:23489:x1875730518765184:12345-0@lo:101:mount.lustre.0 Request processed in 177us (3920us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836627.025785:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788836627.031671:0:23489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f536300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:23489:1875730518765184:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788836627.031706:0:23489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.144@tcp lock: ffff9a8167975c00/0xbd163c7375716161 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375716168 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836627.031719:0:23489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.144@tcp lock: ffff9a8167975c00/0xbd163c7375716161 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd163c7375716168 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788836627.033047:0:23489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:2.0:1788836627.033330:0:23489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788836627.033617:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:2.0:1788836627.033641:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:2.0:1788836627.033653:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:2.0:1788836627.033665:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:2.0:1788836627.033676:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:2.0:1788836627.033689:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:2.0:1788836627.033700:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:2.0:1788836627.033712:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:2.0:1788836627.033724:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:2.0:1788836627.033751:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:2.0:1788836627.033767:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:2.0:1788836627.033780:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:2.0:1788836627.033792:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:2.0:1788836627.033804:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:2.0:1788836627.033817:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:2.0:1788836627.033828:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:2.0:1788836627.033840:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:2.0:1788836627.033855:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:2.0:1788836627.033868:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:2.0:1788836627.033881:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:2.0:1788836627.033895:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:2.0:1788836627.033908:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:2.0:1788836627.033921:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:2.0:1788836627.033935:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:2.0:1788836627.033948:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:2.0:1788836627.033975:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:2.0:1788836627.033992:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:2.0:1788836627.034005:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:2.0:1788836627.034018:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:2.0:1788836627.034056:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:2.0:1788836627.034072:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:2.0:1788836627.034088:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:2.0:1788836627.034101:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:2.0:1788836627.034114:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:2.0:1788836627.034127:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:2.0:1788836627.034140:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:2.0:1788836627.034153:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:2.0:1788836627.034166:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:2.0:1788836627.034181:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:2.0:1788836627.034195:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:2.0:1788836627.034207:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:2.0:1788836627.034231:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:2.0:1788836627.034246:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:2.0:1788836627.034260:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:2.0:1788836627.034273:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:2.0:1788836627.034284:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:2.0:1788836627.034296:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:2.0:1788836627.034309:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:2.0:1788836627.035682:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:2.0:1788836627.035741:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:2.0:1788836627.035768:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:2.0:1788836627.035774:0:23489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:2.0:1788836627.035877:0:23489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f536300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:23489:1875730518765312:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788836627.035952:0:23489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836627.036031:0:23489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8167bfd180 going to sleep for 11 seconds 00000100:00100000:3.0:1788836627.037097:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518765312 00000100:00100000:3.0:1788836627.037107:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518765312 00000100:00100000:3.0:1788836627.037160:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788836627.037170:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8147b92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+18:23489:x1875730518765312:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788836627.037345:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8147b92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+18:23489:x1875730518765312:12345-0@lo:501:mount.lustre.0 Request processed in 175us (1392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836627.037353:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788836627.037423:0:23489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f536300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:23489:1875730518765312:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788836627.037492:0:23489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a81412e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:23489:1875730518765440:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788836627.037552:0:23489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836627.037573:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518765440 00000100:00100000:3.0:1788836627.037577:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518765440 00000100:00100000:3.0:1788836627.037594:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788836627.037600:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8147b90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+18:23489:x1875730518765440:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788836627.037668:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8147b90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+18:23489:x1875730518765440:12345-0@lo:503:mount.lustre.0 Request processed in 67us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836627.037675:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788836627.037716:0:23489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a81585fc480 going to sleep for 11 seconds 00000100:00100000:3.0:1788836627.037729:0:23489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a81412e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:23489:1875730518765440:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788836627.038160:0:23489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788836627.038243:0:23489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a81412e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:23489:1875730518765568:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788836627.038277:0:23489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836627.038301:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518765568 00000100:00100000:3.0:1788836627.038305:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518765568 00000100:00100000:3.0:1788836627.038326:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788836627.038333:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81597d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+18:23489:x1875730518765568:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788836627.038411:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81597d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+18:23489:x1875730518765568:12345-0@lo:502:mount.lustre.0 Request processed in 77us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836627.038425:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788836627.038455:0:23489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a81585fc480 going to sleep for 11 seconds 00000100:00100000:3.0:1788836627.038495:0:23489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a81412e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:23489:1875730518765568:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788836627.038652:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:3.0:1788836627.038677:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:3.0:1788836627.038693:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:3.0:1788836627.038705:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:3.0:1788836627.038718:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:3.0:1788836627.038732:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:3.0:1788836627.038746:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:3.0:1788836627.038759:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:3.0:1788836627.038772:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:3.0:1788836627.038784:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:3.0:1788836627.038797:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:3.0:1788836627.038809:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:3.0:1788836627.038833:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:3.0:1788836627.038847:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:3.0:1788836627.038859:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:3.0:1788836627.038873:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:3.0:1788836627.038887:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:3.0:1788836627.038898:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:3.0:1788836627.038910:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:3.0:1788836627.038922:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:3.0:1788836627.038936:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:3.0:1788836627.038949:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:3.0:1788836627.038962:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:3.0:1788836627.038974:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:3.0:1788836627.038985:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:3.0:1788836627.038996:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:3.0:1788836627.039008:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:3.0:1788836627.039034:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:3.0:1788836627.039075:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:3.0:1788836627.039091:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:3.0:1788836627.039103:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:3.0:1788836627.039116:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:3.0:1788836627.039128:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:3.0:1788836627.039140:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:3.0:1788836627.039152:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:3.0:1788836627.039166:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:3.0:1788836627.039178:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:3.0:1788836627.039189:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:3.0:1788836627.039199:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:3.0:1788836627.039210:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:3.0:1788836627.039222:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:3.0:1788836627.039235:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:3.0:1788836627.039248:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:3.0:1788836627.039261:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:3.0:1788836627.039286:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:3.0:1788836627.039300:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:3.0:1788836627.039313:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:3.0:1788836627.039325:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:3.0:1788836627.039362:0:23489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a81412e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:23489:1875730518765696:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788836627.039408:0:23489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836627.039447:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518765696 00000100:00100000:3.0:1788836627.039452:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518765696 00000100:00100000:3.0:1788836627.039500:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788836627.039508:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81597db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+18:23489:x1875730518765696:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788836627.039585:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81597db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+18:23489:x1875730518765696:12345-0@lo:502:mount.lustre.0 Request processed in 77us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836627.039592:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788836627.039633:0:23489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a81585fc480 going to sleep for 11 seconds 00000100:00100000:3.0:1788836627.039648:0:23489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a81412e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:23489:1875730518765696:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788836627.039778:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:3.0:1788836627.039798:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:3.0:1788836627.039816:0:23489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a81412e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:23489:1875730518765824:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788836627.039846:0:23489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836627.039866:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518765824 00000100:00100000:3.0:1788836627.039869:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518765824 00000100:00100000:3.0:1788836627.039886:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788836627.039891:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81597d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+18:23489:x1875730518765824:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788836627.039945:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81597d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+18:23489:x1875730518765824:12345-0@lo:502:mount.lustre.0 Request processed in 54us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836627.039952:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788836627.039979:0:23489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a81585fc480 going to sleep for 11 seconds 00000100:00100000:3.0:1788836627.039990:0:23489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a81412e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:23489:1875730518765824:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788836627.040021:0:23489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:3.0:1788836627.040028:0:23489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788836627.048069:0:23508:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1788836627.048090:0:23508:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9a816c1099b8) 00000020:00000080:3.0:1788836627.048120:0:23508:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1788836627.048244:0:23508:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a80471cd800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788836627.048249:0:23508:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a80471cd800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788836627.048252:0:23508:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a80471cd800 3 00010000:00080000:3.0:1788836627.048287:0:23508:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a8047c9a800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.201.144@tcp at head 00010000:00010000:2.0:1788836627.053948:0:23508:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1788836627.054170:0:23508:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1788836627.054222:0:23508:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788836627.054237:0:23508:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xbd163c7375716176 00000100:00080000:2.0:1788836627.054249:0:23508:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788836627.054264:0:23508:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9a8047c9a800 using connection 192.168.201.144@tcp/0@lo 00000100:00100000:2.0:1788836627.054308:0:23508:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a817f535880 x1875730518765952/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788836627.054338:0:23508:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788836627.054937:0:16590:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788836627.054943:0:16590:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788836627.054945:0:16590:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788836627.054955:0:16590:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788836627.055053:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f535880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875730518765952:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788836627.055142:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1788836627.055325:0:23508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000100:00100000:3.0:1788836627.055771:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518765952 00000100:00100000:3.0:1788836627.055780:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518765952 00000100:00100000:3.0:1788836627.055816:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788836627.055824:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a816bd77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3617:x1875730518765952:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788836627.055851:0:22755:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 657 last 0 00000020:00000080:3.0:1788836627.055882:0:22755:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xbd163c737571617d 00000004:00100000:3.0:1788836627.055895:0:22755:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788836627.055939:0:22755:0:(import.c:65:import_set_state_nolock()) ffff9a8047c99800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788836627.056005:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a816bd77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875730518765952:12345-0@lo:38:llog_process_th.0 Request processed in 180us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836627.056013:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788836627.056130:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a817f535880 x1875730518765952/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788836637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836627.056141:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788836627.056159:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1788836627.056166:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788836627.056170:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788836627.056172:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9a8047c9a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788836627.056177:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f535880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875730518765952:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1788836627.066557:0:23489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788836627.066605:0:23489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788836627.066623:0:23489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a8167975c00/0xbd163c7375716161 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375716168 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836627.066638:0:23489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.144@tcp lock: ffff9a8167975c00/0xbd163c7375716161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375716168 expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788836627.066689:0:23489:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788836627.066690:0:23489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788836627.066692:0:23489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788836627.066693:0:23489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788836627.066694:0:23489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788836627.066695:0:23489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788836627.066697:0:23489:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788836627.066699:0:23489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788836627.066700:0:23489:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788836627.066703:0:23489:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1788836627.066706:0:23489:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788836627.066707:0:23489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788836627.066708:0:23489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788836627.066709:0:23489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788836627.066710:0:23489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788836627.066711:0:23489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788836627.066712:0:23489:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788836627.066713:0:23489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788836627.066714:0:23489:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788836627.066738:0:23489:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788836627.066757:0:23489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f534e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:23489:1875730518766080:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788836627.066825:0:23489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836627.066875:0:23489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8167bfdd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788836627.067122:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518766080 00000100:00100000:3.0:1788836627.067130:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518766080 00000100:00100000:3.0:1788836627.067183:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788836627.067193:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81597dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+18:23489:x1875730518766080:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788836627.067219:0:22750:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788836627.067234:0:22750:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1788836627.068532:0:22735:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1788836627.068565:0:22750:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788836627.068575:0:22750:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1788836627.068791:0:22771:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788836627.068796:0:22771:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788836627.068817:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a80462e6200/0xbd163c7375716184 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836627.068836:0:22771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8167974000/0xbd163c7375716088 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd163c7375716081 expref: 18 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836627.068858:0:22771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a80462e7e00/0xbd163c737571614c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd163c7375716145 expref: 18 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836627.068864:0:22771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a80462e6200/0xbd163c7375716184 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836627.069082:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81597dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+18:23489:x1875730518766080:12345-0@lo:253:mount.lustre.0 Request processed in 1888us (2254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836627.069092:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788836627.069162:0:23489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f534e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:23489:1875730518766080:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788836627.069175:0:23489:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788836627.069178:0:23489:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788836627.069180:0:23489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788836627.069181:0:23489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788836627.069182:0:23489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788836627.069183:0:23489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788836627.069184:0:23489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788836627.069186:0:23489:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788836627.069188:0:23489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788836627.069190:0:23489:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788836627.069206:0:23489:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1788836627.070014:0:22771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a80462e7e00/0xbd163c737571614c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd163c7375716145 expref: 17 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836627.070034:0:22771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a80462e7e00/0xbd163c737571614c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd163c7375716145 expref: 17 pid: 22750 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836627.070063:0:22771:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a81412e8380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22771:1875730518766208:0@lo:104: 00000100:00100000:3.0:1788836627.070122:0:22771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788836627.070190:0:22771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8167974000/0xbd163c7375716088 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd163c7375716081 expref: 17 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836627.070198:0:22771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8167974000/0xbd163c7375716088 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd163c7375716081 expref: 17 pid: 22750 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836627.070207:0:22771:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a81412e8000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22771:1875730518766336:0@lo:104: 00000100:00100000:3.0:1788836627.070229:0:22771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836627.070248:0:22771:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a81585fc3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836627.070272:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518766208 00000100:00100000:3.0:1788836627.070279:0:22738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518766208 00000100:00100000:3.0:1788836627.070336:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518766336 00000100:00100000:3.0:1788836627.070340:0:22738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518766336 00000100:00100000:3.0:1788836627.070356:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788836627.070364:0:22738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81412e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d9f3bec-9812-4f3e-be22-5440158bfa78+4:22771:x1875730518766208:12345-0@lo:104: 00010000:00010000:3.0:1788836627.071492:0:22738:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.144@tcp lock: ffff9a817f41b400/0xbd163c7375716145 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd163c737571614c expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836627.071572:0:22738:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788836627.071579:0:22738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81412e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d9f3bec-9812-4f3e-be22-5440158bfa78+4:22771:x1875730518766208:12345-0@lo:104: Request processed in 1214us (1455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836627.071588:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788836627.071612:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788836627.071619:0:22738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81412eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d9f3bec-9812-4f3e-be22-5440158bfa78+3:22771:x1875730518766336:12345-0@lo:104: 00010000:00010000:3.0:1788836627.071630:0:22738:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.144@tcp lock: ffff9a8167975400/0xbd163c7375716081 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd163c7375716088 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836627.071658:0:22738:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788836627.071662:0:22738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81412eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d9f3bec-9812-4f3e-be22-5440158bfa78+3:22771:x1875730518766336:12345-0@lo:104: Request processed in 45us (1434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836627.071668:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788836627.071682:0:22743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788836627.071687:0:22743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.144@tcp lock: ffff9a817f41b400/0xbd163c7375716145 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd163c737571614c expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836627.071695:0:22743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a817f41b400 already unused, calling callback (ffffffffc139ec20) 10000000:00010000:3.0:1788836627.071699:0:22743:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.144@tcp lock: ffff9a817f41b400/0xbd163c7375716145 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd163c737571614c expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836627.071709:0:22743:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.144@tcp lock: ffff9a817f41b400/0xbd163c7375716145 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd163c737571614c expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788836627.071717:0:22743:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.144@tcp lock: ffff9a817f41b400/0xbd163c7375716145 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd163c737571614c expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836627.071730:0:22743:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788836627.071760:0:22743:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.144@tcp lock: ffff9a817f41b400/0xbd163c7375716145 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd163c737571614c expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836627.071766:0:22743:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788836627.071784:0:22743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.144@tcp lock: ffff9a817f41b400/0xbd163c7375716145 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd163c737571614c expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836627.071791:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.144@tcp lock: ffff9a817f41b400/0xbd163c7375716145 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd163c737571614c expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836627.071801:0:22743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836627.071804:0:22743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.144@tcp lock: ffff9a8167975400/0xbd163c7375716081 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd163c7375716088 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836627.071809:0:22743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8167975400 already unused, calling callback (ffffffffc139ec20) 10000000:00010000:3.0:1788836627.071812:0:22743:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.144@tcp lock: ffff9a8167975400/0xbd163c7375716081 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd163c7375716088 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836627.071819:0:22743:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.144@tcp lock: ffff9a8167975400/0xbd163c7375716081 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd163c7375716088 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788836627.071825:0:22743:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.144@tcp lock: ffff9a8167975400/0xbd163c7375716081 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd163c7375716088 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836627.071830:0:22743:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788836627.071839:0:22743:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.144@tcp lock: ffff9a8167975400/0xbd163c7375716081 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd163c7375716088 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836627.071844:0:22743:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788836627.071862:0:22743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.144@tcp lock: ffff9a8167975400/0xbd163c7375716081 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd163c7375716088 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836627.071868:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.144@tcp lock: ffff9a8167975400/0xbd163c7375716081 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd163c7375716088 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836627.071881:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836627.071883:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836627.071884:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836627.071890:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836627.071897:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788836627.072105:0:22771:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a81412e8380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22771:1875730518766208:0@lo:104: 00000100:00100000:0.0:1788836627.072115:0:22771:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a81412e8000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22771:1875730518766336:0@lo:104: 00010000:00010000:0.0:1788836627.072136:0:22771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a80462e6200/0xbd163c7375716184 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836627.072454:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a81412e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d9f3bec-9812-4f3e-be22-5440158bfa78:3620:1875730518766464:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788836627.072518:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836627.072560:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a81412e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d9f3bec-9812-4f3e-be22-5440158bfa78:3618:1875730518766592:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788836627.072578:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836627.072616:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518766464 00000100:00100000:3.0:1788836627.072620:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518766464 00010000:00010000:3.0:1788836627.072638:0:22741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a80462e7e00/0xbd163c737571614c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd163c7375716145 expref: 18 pid: 22750 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836627.072659:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518766592 00000100:00100000:3.0:1788836627.072661:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518766592 00010000:00010000:3.0:1788836627.072669:0:22741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8167974000/0xbd163c7375716088 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd163c7375716081 expref: 19 pid: 22750 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836627.072679:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788836627.072685:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81412eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d9f3bec-9812-4f3e-be22-5440158bfa78+19:3620:x1875730518766464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788836627.072695:0:22741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836627.072700:0:22741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a80462e7e00/0xbd163c737571614c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd163c7375716145 expref: 19 pid: 22750 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836627.072721:0:22741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a80462e7e00/0xbd163c737571614c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd163c7375716145 expref: 19 pid: 22750 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836627.072734:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a80462e7e00/0xbd163c737571614c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd163c7375716145 expref: 19 pid: 22750 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836627.072745:0:22741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836627.072784:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81412eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d9f3bec-9812-4f3e-be22-5440158bfa78+18:3620:x1875730518766464:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836627.072791:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788836627.072803:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788836627.072808:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81412e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d9f3bec-9812-4f3e-be22-5440158bfa78+17:3618:x1875730518766592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788836627.072815:0:22741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836627.072819:0:22741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8167974000/0xbd163c7375716088 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd163c7375716081 expref: 17 pid: 22750 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836627.072827:0:22741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8167974000/0xbd163c7375716088 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd163c7375716081 expref: 17 pid: 22750 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836627.072836:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8167974000/0xbd163c7375716088 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd163c7375716081 expref: 17 pid: 22750 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836627.072846:0:22741:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a80462e6200/0xbd163c7375716184 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836627.072854:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a80462e6200/0xbd163c7375716184 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788836627.072866:0:22741:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004070112s 00010000:00010000:3.0:1788836627.072875:0:22741:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a80462e6200/0xbd163c7375716184 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836627.072883:0:22741:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a80462e6200/0xbd163c7375716184 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836627.072889:0:22741:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a80462e6200/0xbd163c7375716184 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836627.072895:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a80462e6200/0xbd163c7375716184 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836627.072901:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a80462e6200 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:3.0:1788836627.072905:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a80462e6200/0xbd163c7375716184 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836627.076282:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a80462e6200/0xbd163c7375716184 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836627.076313:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a80462e6200/0xbd163c7375716184 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836627.076333:0:22741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836627.076434:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81412e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d9f3bec-9812-4f3e-be22-5440158bfa78+16:3618:x1875730518766592:12345-0@lo:103:ldlm_bl.0 Request processed in 3620us (3850us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836627.076445:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788836627.076543:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a81412e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d9f3bec-9812-4f3e-be22-5440158bfa78:3620:1875730518766464:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788836627.076576:0:22771:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a80462e6200/0xbd163c7375716184 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836627.076585:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a80462e6200/0xbd163c7375716184 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836627.076599:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a80462e6200/0xbd163c7375716184 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836627.076961:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a81412e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d9f3bec-9812-4f3e-be22-5440158bfa78:3618:1875730518766592:0@lo:103:ldlm_bl.0 00000040:01000000:2.0:1788836627.082179:0:23489:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1788836627.082315:0:23513:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1788836627.082321:0:23513:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788836627.083131:0:23514:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788836627.083527:0:23489:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:0.0:1788836627.084123:0:23514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788836627.087109:0:23514:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788836627.087195:0:23514:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:3.0:1788836627.087713:0:23515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a81412e9c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23515:1875730518766720:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788836627.087785:0:23515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836627.087831:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518766720 00000100:00100000:3.0:1788836627.087838:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518766720 00000100:00100000:3.0:1788836627.087883:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788836627.087892:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81412e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23515:x1875730518766720:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788836627.087985:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81412e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23515:x1875730518766720:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 93us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836627.087993:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788836627.088019:0:23515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a81585fc000 going to sleep for 11 seconds 00000100:00100000:3.0:1788836627.088054:0:23515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a81412e9c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23515:1875730518766720:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1788836627.088089:0:23515:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788836627.088114:0:23515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a81412e9c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23515:1875730518766848:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788836627.088142:0:23515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836627.088162:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518766848 00000100:00100000:3.0:1788836627.088165:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518766848 00000100:00100000:3.0:1788836627.088185:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788836627.088191:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81412ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23515:x1875730518766848:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788836627.088289:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81412ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23515:x1875730518766848:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 97us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836627.088310:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788836627.088330:0:23515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a81585fc000 going to sleep for 11 seconds 00000100:00100000:3.0:1788836627.088343:0:23515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a81412e9c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23515:1875730518766848:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788836627.088594:0:23515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a81412e9c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23515:1875730518766976:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788836627.088627:0:23515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836627.088668:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518766976 00000100:00100000:3.0:1788836627.088672:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518766976 00000100:00100000:3.0:1788836627.088699:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788836627.088705:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81412e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23515:x1875730518766976:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788836627.088740:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81412e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23515:x1875730518766976:12345-0@lo:900:lod0001_rec0000.0 Request processed in 35us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836627.088746:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788836627.088766:0:23515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a81585fc840 going to sleep for 11 seconds 00010000:00080000:3.0:1788836627.088782:0:23515:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a81412e9c00 x1875730518766976/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788836643 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836627.088792:0:23515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a81412e9c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23515:1875730518766976:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788836627.088828:0:23515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a81412e9c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23515:1875730518767104:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788836627.088855:0:23515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836627.088874:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518767104 00000100:00100000:3.0:1788836627.088878:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518767104 00000100:00100000:3.0:1788836627.088899:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788836627.092490:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81412eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23515:x1875730518767104:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788836627.092636:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81412eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23515:x1875730518767104:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 3729us (3778us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836627.092665:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788836627.092712:0:23515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a81585fc000 going to sleep for 11 seconds 00000100:00100000:3.0:1788836627.092743:0:23515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a81412e9c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23515:1875730518767104:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1788836627.092803:0:23515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1788836627.093577:0:23489:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1788836627.093633:0:23489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788836627.094619:0:23489:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788836627.094633:0:23489:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1788836627.094696:0:23489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788836627.100512:0:23489:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788836627.101061:0:23515:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788836627.101127:0:23515:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788836627.101132:0:23515:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000040:00080000:0.0:1788836627.102343:0:23489:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788836627.104025:0:23489:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1788836627.104619:0:23489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788836627.106260:0:23489:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000001:00000004:0.0:1788836627.109416:0:23489:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00010000:00010000:1.0:1788836627.110681:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788836627.111072:0:23489:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788836627.111108:0:23489:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffae36c1977988 00100000:10000000:0.0:1788836627.111117:0:23489:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1788836627.111686:0:23489:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788836627.111715:0:23489:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.144@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788836627.111733:0:23489:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788836627.111757:0:23489:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1788836627.114612:0:23489:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788836627.114829:0:23489:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788836627.497009:0:22797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8179dd8300 going to sleep for 0 seconds 00010000:00010000:0.0:1788836628.138115:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788836628.141407:0:23516:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788836628.517595:0:22797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8179dd8300 going to sleep for 0 seconds 10000000:01000000:3.0:1788836628.773881:0:22752:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788836628.773889:0:22752:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a80471cd800 from 12 10000000:01000000:3.0:1788836628.773895:0:22752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788836628.773964:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a80462e6200/0xbd163c737571618b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836628.773976:0:22752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.144@tcp lock: ffff9a80462e6200/0xbd163c737571618b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836628.773988:0:22752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.144@tcp lock: ffff9a80462e6200/0xbd163c737571618b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836628.774021:0:22752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a81412e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518767232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788836628.774090:0:22752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836628.774135:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a81585fc480 going to sleep for 11 seconds 00000100:00100000:0.0:1788836628.774274:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518767232 00000100:00100000:0.0:1788836628.774282:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518767232 00000100:00100000:0.0:1788836628.774331:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788836628.774340:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81597d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+16:22752:x1875730518767232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788836628.774353:0:22748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836628.774374:0:22748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a804738d400/0xbd163c7375716192 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd163c737571618b expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836628.774397:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a804738d400/0xbd163c7375716192 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd163c737571618b expref: 17 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836628.774408:0:22748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a804738d400/0xbd163c7375716192 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd163c737571618b expref: 17 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836628.774417:0:22748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a804738d400, rc 0) 00000100:00100000:0.0:1788836628.774479:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81597d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+17:22752:x1875730518767232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836628.774485:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788836628.774612:0:22752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a81412e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518767232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788836628.774626:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.144@tcp lock: ffff9a80462e6200/0xbd163c737571618b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375716192 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836628.774635:0:22752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.144@tcp lock: ffff9a80462e6200/0xbd163c737571618b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd163c7375716192 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836628.774708:0:22752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f534e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518767360:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788836628.774737:0:22752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836628.774767:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8151620f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788836628.774962:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518767360 00000100:00100000:0.0:1788836628.774967:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518767360 00000100:00100000:0.0:1788836628.774996:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788836628.775002:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81597da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+17:22752:x1875730518767360:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788836628.775024:0:22750:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788836628.775040:0:22750:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788836628.775042:0:22750:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:0.0:1788836628.775107:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81597da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+17:22752:x1875730518767360:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 105us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836628.775114:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788836628.775225:0:22752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f534e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518767360:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788836628.775264:0:22752:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788836628.775270:0:22752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a80462e6200/0xbd163c737571618b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375716192 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836628.775278:0:22752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.144@tcp lock: ffff9a80462e6200/0xbd163c737571618b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375716192 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836628.775287:0:22752:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788836628.775289:0:22752:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a8166ee6000 from 12 10000000:01000000:2.0:1788836628.775291:0:22752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788836628.775306:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a8167975400/0xbd163c7375716199 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836628.775313:0:22752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.144@tcp lock: ffff9a8167975400/0xbd163c7375716199 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836628.775321:0:22752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.144@tcp lock: ffff9a8167975400/0xbd163c7375716199 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836628.775332:0:22752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f534e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518767488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788836628.775353:0:22752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836628.775379:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a81411ca6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836628.775512:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518767488 00000100:00100000:0.0:1788836628.775516:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518767488 00000100:00100000:0.0:1788836628.775543:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788836628.775549:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81597dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+17:22752:x1875730518767488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788836628.775555:0:22750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836628.775564:0:22750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a804738cc00/0xbd163c73757161a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd163c7375716199 expref: -99 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836628.775577:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a804738cc00/0xbd163c73757161a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd163c7375716199 expref: 18 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836628.775585:0:22750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a804738cc00/0xbd163c73757161a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd163c7375716199 expref: 18 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836628.775592:0:22750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a804738cc00, rc 0) 00000100:00100000:0.0:1788836628.775615:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81597dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+18:22752:x1875730518767488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 67us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836628.775621:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788836628.776304:0:22752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f534e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518767488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788836628.776327:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.144@tcp lock: ffff9a8167975400/0xbd163c7375716199 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c73757161a0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836628.776335:0:22752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.144@tcp lock: ffff9a8167975400/0xbd163c7375716199 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd163c73757161a0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836628.776391:0:22752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f534e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518767616:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788836628.776433:0:22752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836628.776484:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a81411ca6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836628.776592:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518767616 00000100:00100000:0.0:1788836628.776598:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518767616 00000100:00100000:0.0:1788836628.776635:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788836628.776643:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81597d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+18:22752:x1875730518767616:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788836628.776656:0:22750:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788836628.776681:0:22750:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788836628.776684:0:22750:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:0.0:1788836628.776763:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81597d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+18:22752:x1875730518767616:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 120us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836628.776770:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788836628.777919:0:22752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f534e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518767616:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788836628.777985:0:22752:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788836628.777994:0:22752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a8167975400/0xbd163c7375716199 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c73757161a0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836628.778002:0:22752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.144@tcp lock: ffff9a8167975400/0xbd163c7375716199 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c73757161a0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836629.158821:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788836629.161841:0:23516:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788836629.545532:0:22797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8179dd8300 going to sleep for 0 seconds 00010000:00010000:0.0:1788836630.183550:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836630.565686:0:22797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8179dd8300 going to sleep for 0 seconds 00010000:00010000:2.0:1788836631.208036:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788836631.515779:0:23758:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg144-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788836631.590417:0:22797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8179dd8300 going to sleep for 0 seconds 00010000:00010000:2.0:1788836632.237325:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788836632.424305:0:16590:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788836632.424311:0:16590:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788836632.424314:0:16590:0:(import.c:65:import_set_state_nolock()) ffff9a81646c4000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788836632.424335:0:16590:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a81646c4000 using connection 192.168.201.144@tcp/0@lo 00000100:00100000:1.0:1788836632.424358:0:16590:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8172d94000 x1875730518767872/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788836632.424373:0:16590:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788836632.424377:0:16590:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788836632.424380:0:16590:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788836632.424383:0:16590:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788836632.424404:0:16590:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788836632.424407:0:16590:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788836632.424409:0:16590:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788836632.424412:0:16590:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788836632.424436:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875730518768256:0@lo:400:kworker.0 00000100:00100000:1.0:1788836632.424534:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836632.424586:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788836632.424592:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d9f3bec-9812-4f3e-be22-5440158bfa78:3618:1875730518767744:0@lo:400:kworker.0 00000100:00100000:1.0:1788836632.424619:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836632.424655:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518767744 00000100:00100000:1.0:1788836632.424662:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518767744 00000100:00100000:1.0:1788836632.424704:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788836632.424714:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8181ba9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+18:3618:x1875730518767744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836632.424763:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8181ba9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+18:3618:x1875730518767744:12345-0@lo:400:kworker.0 Request processed in 50us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836632.424771:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788836632.424827:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d9f3bec-9812-4f3e-be22-5440158bfa78:3618:1875730518767744:0@lo:400:kworker.0 00000100:00100000:0.0:1788836632.425008:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875730518767872:0@lo:38:kworker.0 00000100:00100000:0.0:1788836632.425041:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836632.425153:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875730518768384:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788836632.425183:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836632.425219:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875730518768000:0@lo:400:kworker.0 00000100:00100000:3.0:1788836632.425243:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836632.425260:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788836632.425265:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875730518768128:0@lo:400:kworker.0 00000100:00100000:3.0:1788836632.425285:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836632.425312:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518768256 00000100:00100000:3.0:1788836632.425315:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518768256 00000100:00100000:3.0:1788836632.425342:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518768000 00000100:00100000:3.0:1788836632.425344:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518768000 00000100:00100000:3.0:1788836632.425357:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788836632.425363:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8172d94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875730518768256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836632.425393:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8172d94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875730518768256:12345-0@lo:400:kworker.0 Request processed in 31us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836632.425399:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788836632.425411:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788836632.425415:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81412e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875730518768000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836632.425443:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81412e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875730518768000:12345-0@lo:400:kworker.0 Request processed in 27us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836632.425448:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788836632.425485:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518767872 00000100:00100000:3.0:1788836632.425489:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518767872 00000100:00100000:3.0:1788836632.425499:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518768384 00000100:00100000:3.0:1788836632.425502:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518768384 00000100:00100000:3.0:1788836632.425512:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518768128 00000100:00100000:3.0:1788836632.425514:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518768128 00000100:00100000:3.0:1788836632.425525:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788836632.425529:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a816bd74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3617:x1875730518767872:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788836632.425551:0:22760:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 662 last 0 00000020:00000080:3.0:1788836632.425593:0:22760:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbd163c73757161a7 00000004:00100000:3.0:1788836632.425608:0:22760:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788836632.425613:0:22760:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:3.0:1788836632.425687:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788836632.425694:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81412e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3619:x1875730518768384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788836632.425716:0:23498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788836632.425750:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81412e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3619:x1875730518768384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 57us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836632.425756:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788836632.425769:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788836632.425775:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a804724ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875730518768128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836632.425801:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a804724ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875730518768128:12345-0@lo:400:kworker.0 Request processed in 26us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836632.425807:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788836632.425917:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875730518768384:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788836632.425959:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875730518768128:0@lo:400:kworker.0 00010000:00080000:3.0:1788836632.425973:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8172d95180 x1875730518768000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836632.425983:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875730518768000:0@lo:400:kworker.0 00010000:00080000:1.0:1788836632.426135:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8172d97100 x1875730518768256/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836632.426145:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875730518768256:0@lo:400:kworker.0 00000100:00080000:3.0:1788836632.432798:0:22760:0:(import.c:65:import_set_state_nolock()) ffff9a8047c9a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788836632.433008:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a816bd74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3617:x1875730518767872:12345-0@lo:38:kworker.0 Request processed in 7475us (7964us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836632.433019:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1788836632.433124:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788836632.433134:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788836632.433139:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788836632.433142:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9a81646c4000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1788836632.433162:0:3617:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000020336607): req@ffff9a817f535c00 x1875730518760448/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836632.433188:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875730518767872:0@lo:38:kworker.0 00000100:00100000:0.0:1788836632.433249:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f534e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875730518768512:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788836632.433288:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836632.433327:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518768512 00000100:00100000:2.0:1788836632.433334:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518768512 00000100:00100000:0.0:1788836632.433455:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788836632.433481:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a816bd77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3620:x1875730518768512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788836632.433508:0:22761:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788836632.433550:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a816bd77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3620:x1875730518768512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836632.433557:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788836632.434134:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f534e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875730518768512:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788836632.440559:0:22797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836632.440611:0:22797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8179dd8300 going to sleep for 11 seconds 00000100:00100000:2.0:1788836632.440643:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518760448 00000100:00100000:2.0:1788836632.440654:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518760448 00000100:00100000:2.0:1788836632.440795:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788836632.440807:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a804724fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22797:x1875730518760448:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788836632.440908:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a804724fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22797:x1875730518760448:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 103us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836632.440923:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788836632.441498:0:22797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f535c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22797:1875730518760448:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1788836632.441538:0:22797:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788836632.441582:0:22797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d97100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22797:1875730518768640:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788836632.441619:0:22797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836632.441644:0:22797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8047620540 going to sleep for 11 seconds 00000100:00100000:2.0:1788836632.441668:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518768640 00000100:00100000:2.0:1788836632.441739:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518768640 00000100:00100000:2.0:1788836632.441822:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788836632.441831:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8172d96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22797:x1875730518768640:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788836632.441962:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8172d96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22797:x1875730518768640:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 131us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836632.441969:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788836632.442377:0:22797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d97100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22797:1875730518768640:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788836632.442443:0:22797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d97100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22797:1875730518768768:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788836632.442494:0:22797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836632.442516:0:22797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8047620540 going to sleep for 11 seconds 00000100:00100000:3.0:1788836632.442519:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518768768 00000100:00100000:3.0:1788836632.442525:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518768768 00000100:00100000:3.0:1788836632.442557:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788836632.442565:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8172d97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22797:x1875730518768768:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788836632.442640:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8172d97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22797:x1875730518768768:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 76us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836632.442648:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788836632.442927:0:22797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d97100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22797:1875730518768768:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1788836632.442973:0:22797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788836632.450730:0:22797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788836632.450808:0:22797:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 20, retries 0 00000004:00080000:1.0:1788836632.450813:0:22797:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:1.0:1788836632.729748:0:23812:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788836632.729976:0:23812:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788836633.253849:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788836633.704143:0:23862:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788836633.704352:0:23862:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788836634.283297:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788836634.598380:0:22791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:2.0:1788836634.833755:0:23910:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc44fec950 20000000:00000080:2.0:1788836634.833772:0:23910:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a81733a7c00 uarg=0000000000000000 20000000:01000000:2.0:1788836634.833809:0:23910:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788836634.833815:0:23910:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788836634.833819:0:23910:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788836634.834363:0:23911:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1788836634.834537:0:23910:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788836634.839797:0:23910:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788836634.839826:0:23910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a8167974400/0xbd163c73757161ae lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836634.839844:0:23910:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a80462e7200/0xbd163c7375716057 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd163c7375716050 expref: 17 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836634.839850:0:23910:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a817f41aa00/0xbd163c737571615a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd163c7375716153 expref: 17 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836634.839856:0:23910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a8167974400/0xbd163c73757161ae lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836634.839926:0:23910:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a817f41aa00/0xbd163c737571615a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd163c7375716153 expref: 17 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836634.839940:0:23910:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a817f41aa00/0xbd163c737571615a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd163c7375716153 expref: 17 pid: 22750 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836634.839954:0:23910:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f537480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23910:1875730518768896:0@lo:104: 00000100:00100000:2.0:1788836634.840372:0:23910:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788836634.840437:0:23910:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a80462e7200/0xbd163c7375716057 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd163c7375716050 expref: 17 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836634.840448:0:23910:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a80462e7200/0xbd163c7375716057 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd163c7375716050 expref: 17 pid: 22748 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836634.840457:0:23910:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f537800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23910:1875730518769024:0@lo:104: 00000100:00100000:2.0:1788836634.840636:0:23910:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836634.840671:0:23910:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a804634c180 going to sleep for 11 seconds 00000100:00100000:3.0:1788836634.840682:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518768896 00000100:00100000:3.0:1788836634.840691:0:22738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518768896 00000100:00100000:0.0:1788836634.840720:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518769024 00000100:00100000:0.0:1788836634.840724:0:22739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518769024 00000100:00100000:3.0:1788836634.840743:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788836634.840752:0:22738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f534a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d9f3bec-9812-4f3e-be22-5440158bfa78+4:23910:x1875730518768896:12345-0@lo:104: 00010000:00010000:3.0:1788836634.840769:0:22738:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.144@tcp lock: ffff9a804738dc00/0xbd163c7375716153 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd163c737571615a expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836634.840841:0:22738:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788836634.840846:0:22738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f534a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d9f3bec-9812-4f3e-be22-5440158bfa78+4:23910:x1875730518768896:12345-0@lo:104: Request processed in 95us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836634.840852:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788836634.840869:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788836634.840874:0:22738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f537100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d9f3bec-9812-4f3e-be22-5440158bfa78+3:23910:x1875730518769024:12345-0@lo:104: 00010000:00010000:3.0:1788836634.840881:0:22738:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.144@tcp lock: ffff9a8167974c00/0xbd163c7375716050 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd163c7375716057 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836634.840924:0:22738:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788836634.840930:0:22738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f537100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d9f3bec-9812-4f3e-be22-5440158bfa78+3:23910:x1875730518769024:12345-0@lo:104: Request processed in 57us (294us total) trans 0 rc 0/0 00010000:00010000:0.0:1788836634.840934:0:22743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1788836634.840936:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1788836634.840940:0:22743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.144@tcp lock: ffff9a804738dc00/0xbd163c7375716153 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd163c737571615a expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836634.840956:0:22743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a804738dc00 already unused, calling callback (ffffffffc139ec20) 00010000:00010000:3.0:1788836634.840960:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:0.0:1788836634.840961:0:22743:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.144@tcp lock: ffff9a804738dc00/0xbd163c7375716153 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd163c737571615a expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836634.840969:0:22743:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.144@tcp lock: ffff9a804738dc00/0xbd163c7375716153 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd163c737571615a expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788836634.840987:0:22743:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.144@tcp lock: ffff9a804738dc00/0xbd163c7375716153 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd163c737571615a expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836634.840993:0:22743:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788836634.841027:0:22743:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.144@tcp lock: ffff9a804738dc00/0xbd163c7375716153 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd163c737571615a expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836634.841033:0:22743:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788836634.841052:0:22743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.144@tcp lock: ffff9a804738dc00/0xbd163c7375716153 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd163c737571615a expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836634.841058:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.144@tcp lock: ffff9a804738dc00/0xbd163c7375716153 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd163c737571615a expref: -99 pid: 23489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836634.841071:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836634.841073:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836634.841075:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836634.841096:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d9f3bec-9812-4f3e-be22-5440158bfa78:3621:1875730518769152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788836634.841126:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836634.841209:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518769152 00000100:00100000:3.0:1788836634.841214:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518769152 00010000:00010000:3.0:1788836634.841231:0:22741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a817f41aa00/0xbd163c737571615a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd163c7375716153 expref: 18 pid: 22750 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836634.841254:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788836634.841261:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a816bd77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d9f3bec-9812-4f3e-be22-5440158bfa78+18:3621:x1875730518769152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788836634.841272:0:22741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836634.841277:0:22741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a817f41aa00/0xbd163c737571615a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd163c7375716153 expref: 18 pid: 22750 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836634.841288:0:22741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a817f41aa00/0xbd163c737571615a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd163c7375716153 expref: 18 pid: 22750 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836634.841305:0:22741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836634.841344:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a816bd77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d9f3bec-9812-4f3e-be22-5440158bfa78+18:3621:x1875730518769152:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836634.841351:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788836634.841499:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d9f3bec-9812-4f3e-be22-5440158bfa78:3621:1875730518769152:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788836634.841549:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836634.841557:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836634.841559:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836634.841602:0:23910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a817f41aa00/0xbd163c737571615a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd163c7375716153 expref: 17 pid: 22750 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836634.841613:0:23910:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f537480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23910:1875730518768896:0@lo:104: 00000100:00100000:2.0:1788836634.841623:0:23910:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f537800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23910:1875730518769024:0@lo:104: 00010000:00010000:2.0:1788836634.841639:0:23910:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a8167974400/0xbd163c73757161ae lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836634.841695:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.144@tcp lock: ffff9a8167974c00/0xbd163c7375716050 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd163c7375716057 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836634.841703:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8167974c00 already unused, calling callback (ffffffffc139ec20) 10000000:00010000:3.0:1788836634.841706:0:22744:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.144@tcp lock: ffff9a8167974c00/0xbd163c7375716050 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd163c7375716057 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836634.841715:0:22744:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.144@tcp lock: ffff9a8167974c00/0xbd163c7375716050 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd163c7375716057 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788836634.841721:0:22744:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.144@tcp lock: ffff9a8167974c00/0xbd163c7375716050 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd163c7375716057 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836634.841732:0:22744:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788836634.841790:0:22744:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.144@tcp lock: ffff9a8167974c00/0xbd163c7375716050 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd163c7375716057 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836634.841798:0:22744:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788836634.841824:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.144@tcp lock: ffff9a8167974c00/0xbd163c7375716050 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd163c7375716057 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836634.841831:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.144@tcp lock: ffff9a8167974c00/0xbd163c7375716050 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd163c7375716057 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836634.841845:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836634.841846:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836634.841847:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836634.841854:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788836634.841862:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a804724c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d9f3bec-9812-4f3e-be22-5440158bfa78:3619:1875730518769280:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788836634.841892:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836634.841939:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518769280 00000100:00100000:3.0:1788836634.841943:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518769280 00010000:00010000:3.0:1788836634.841959:0:22740:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a80462e7200/0xbd163c7375716057 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd163c7375716050 expref: 17 pid: 22748 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836634.841995:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788836634.842002:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a804724ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d9f3bec-9812-4f3e-be22-5440158bfa78+17:3619:x1875730518769280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788836634.842011:0:22740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836634.842014:0:22740:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a80462e7200/0xbd163c7375716057 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd163c7375716050 expref: 17 pid: 22748 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836634.842022:0:22740:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a80462e7200/0xbd163c7375716057 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd163c7375716050 expref: 17 pid: 22748 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836634.842039:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a80462e7200/0xbd163c7375716057 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd163c7375716050 expref: 17 pid: 22748 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836634.842050:0:22740:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a8167974400/0xbd163c73757161ae lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836634.842058:0:22740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8167974400/0xbd163c73757161ae lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836634.842071:0:22740:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8167974400/0xbd163c73757161ae lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836634.842079:0:22740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8167974400/0xbd163c73757161ae lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836634.842624:0:22740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a8167974400/0xbd163c73757161ae lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836634.842631:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a8167974400/0xbd163c73757161ae lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836634.842636:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8167974400 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:3.0:1788836634.842640:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a8167974400/0xbd163c73757161ae lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836634.842647:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a8167974400/0xbd163c73757161ae lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836634.842673:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a8167974400/0xbd163c73757161ae lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836634.842696:0:22740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788836634.842711:0:23910:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a8167974400/0xbd163c73757161ae lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836634.842720:0:23910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a8167974400/0xbd163c73757161ae lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836634.842726:0:23910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8167974400/0xbd163c73757161ae lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836634.842739:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a804724ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d9f3bec-9812-4f3e-be22-5440158bfa78+16:3619:x1875730518769280:12345-0@lo:103:ldlm_bl.0 Request processed in 738us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836634.842747:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788836634.842781:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a804724c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d9f3bec-9812-4f3e-be22-5440158bfa78:3619:1875730518769280:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788836635.301625:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788836636.263317:0:22752:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788836636.263327:0:22752:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a80471cd800 from 13 10000000:01000000:2.0:1788836636.263334:0:22752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788836636.263399:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a8167975800/0xbd163c73757161b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836636.263411:0:22752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.144@tcp lock: ffff9a8167975800/0xbd163c73757161b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836636.263421:0:22752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.144@tcp lock: ffff9a8167975800/0xbd163c73757161b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836636.263447:0:22752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f537800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518769408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788836636.263649:0:22752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836636.263695:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a804634c000 going to sleep for 11 seconds 00000100:00100000:3.0:1788836636.263781:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518769408 00000100:00100000:3.0:1788836636.263789:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518769408 00000100:00100000:3.0:1788836636.263847:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788836636.263857:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8181bab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+16:22752:x1875730518769408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788836636.263871:0:22749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836636.263896:0:22749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a80462e7200/0xbd163c73757161bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd163c73757161b5 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836636.263919:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a80462e7200/0xbd163c73757161bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd163c73757161b5 expref: 17 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836636.263929:0:22749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a80462e7200/0xbd163c73757161bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd163c73757161b5 expref: 17 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836636.263938:0:22749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a80462e7200, rc 0) 00000100:00100000:3.0:1788836636.263985:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8181bab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+17:22752:x1875730518769408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836636.263991:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788836636.264746:0:22752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f537800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518769408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788836636.264773:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.144@tcp lock: ffff9a8167975800/0xbd163c73757161b5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c73757161bc expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836636.264783:0:22752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.144@tcp lock: ffff9a8167975800/0xbd163c73757161b5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd163c73757161bc expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836636.264860:0:22752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f537800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518769536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836636.264903:0:22752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836636.264927:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a804634c000 going to sleep for 11 seconds 00000100:00100000:0.0:1788836636.265108:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518769536 00000100:00100000:0.0:1788836636.265114:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518769536 00000100:00100000:0.0:1788836636.265146:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788836636.265153:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8181ba8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+17:22752:x1875730518769536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788836636.265275:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8181ba8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+17:22752:x1875730518769536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 123us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836636.265282:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788836636.265915:0:22752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f537800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518769536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836636.265973:0:22752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f537800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518769664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836636.266024:0:22752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836636.266054:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a804634c000 going to sleep for 11 seconds 00000100:00100000:1.0:1788836636.266291:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518769664 00000100:00100000:1.0:1788836636.266297:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518769664 00000100:00100000:1.0:1788836636.266348:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788836636.266356:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8181bab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+17:22752:x1875730518769664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788836636.266695:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8181bab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+17:22752:x1875730518769664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 339us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836636.266703:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788836636.266934:0:22752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f537800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518769664:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788836636.269591:0:23972:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788836636.269914:0:22752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788836636.269936:0:22752:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788836636.269949:0:22752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a8167975800/0xbd163c73757161b5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c73757161bc expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836636.269981:0:22752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.144@tcp lock: ffff9a8167975800/0xbd163c73757161b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c73757161bc expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836636.269991:0:22752:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788836636.270004:0:22752:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a8166ee6000 from 13 10000000:01000000:3.0:1788836636.270008:0:22752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788836636.270046:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a80462e7e00/0xbd163c73757161c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836636.270054:0:22752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.144@tcp lock: ffff9a80462e7e00/0xbd163c73757161c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836636.270065:0:22752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.144@tcp lock: ffff9a80462e7e00/0xbd163c73757161c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836636.270088:0:22752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a804724c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518769792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788836636.270150:0:22752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836636.270195:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a804760c180 going to sleep for 11 seconds 00000100:00100000:1.0:1788836636.270594:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518769792 00000100:00100000:1.0:1788836636.270602:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518769792 00000100:00100000:1.0:1788836636.270658:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788836636.270669:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8181baa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+17:22752:x1875730518769792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788836636.270682:0:22749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836636.270695:0:22749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a817f41a800/0xbd163c73757161ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd163c73757161c3 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836636.270718:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a817f41a800/0xbd163c73757161ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd163c73757161c3 expref: 18 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836636.270728:0:22749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a817f41a800/0xbd163c73757161ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd163c73757161c3 expref: 18 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836636.270736:0:22749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a817f41a800, rc 0) 00000100:00100000:1.0:1788836636.270783:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8181baa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+18:22752:x1875730518769792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836636.270789:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788836636.270869:0:22752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a804724c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518769792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788836636.270891:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.144@tcp lock: ffff9a80462e7e00/0xbd163c73757161c3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c73757161ca expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836636.270899:0:22752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.144@tcp lock: ffff9a80462e7e00/0xbd163c73757161c3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd163c73757161ca expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836636.270952:0:22752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a804724c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518769920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788836636.270979:0:22752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836636.271022:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a804760c180 going to sleep for 11 seconds 00000100:00100000:0.0:1788836636.271088:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518769920 00000100:00100000:0.0:1788836636.271092:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518769920 00000100:00100000:0.0:1788836636.271126:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788836636.271134:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8181ba9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+18:22752:x1875730518769920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788836636.271251:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8181ba9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+18:22752:x1875730518769920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836636.271258:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788836636.271424:0:22752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a804724c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518769920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788836636.271453:0:22752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a804724c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518770048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788836636.271541:0:22752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836636.271565:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a804760c180 going to sleep for 11 seconds 00000100:00100000:1.0:1788836636.272245:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518770048 00000100:00100000:1.0:1788836636.272251:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518770048 00000100:00100000:1.0:1788836636.272283:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788836636.272291:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f3e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+18:22752:x1875730518770048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788836636.272393:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f3e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+18:22752:x1875730518770048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 102us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836636.272410:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788836636.272778:0:22752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a804724c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518770048:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788836636.281603:0:23973:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788836636.281815:0:22752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788836636.281840:0:22752:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788836636.281851:0:22752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a80462e7e00/0xbd163c73757161c3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c73757161ca expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836636.281863:0:22752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.144@tcp lock: ffff9a80462e7e00/0xbd163c73757161c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c73757161ca expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836636.325653:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836636.517683:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788836626/real 1788836626] req@ffff9a81412eb100 x1875730518763904/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836636 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836636.517718:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a81412eb100 x1875730518763904/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836636 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836636.517729:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788836621/real 1788836621] req@ffff9a817f535f80 x1875730518761472/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836636 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836636.517742:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a817f535f80 x1875730518761472/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836636 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836636.517751:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788836621/real 1788836621] req@ffff9a817f535180 x1875730518761600/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836636 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836636.517761:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a817f535180 x1875730518761600/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836636 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788836636.517779:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9a8181a72800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788836636.517801:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788836636.517806:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a81412eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875730518763904:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788836636.517813:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9a815f7e7000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788836636.517846:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788836636.517849:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f535f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875730518761472:0@lo:8:kworker.0 00000100:00080000:3.0:1788836636.517854:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9a8158dbd800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788836636.517862:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788836636.517865:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f535180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875730518761600:0@lo:8:kworker.0 00000100:00080000:2.0:1788836636.517886:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788836636.517893:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788836636.517896:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a815f7e7000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1788836636.522003:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788836636.522031:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f537800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875730518770176:0@lo:400:kworker.0 00000100:00100000:0.0:1788836636.522135:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836636.523539:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518770176 00000100:00100000:3.0:1788836636.523552:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518770176 00000100:00100000:3.0:1788836636.523608:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788836636.523629:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a816bd74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3618:x1875730518770176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836636.524380:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a816bd74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3618:x1875730518770176:12345-0@lo:400:kworker.0 Request processed in 751us (2242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836636.524390:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788836636.524441:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f537800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875730518770176:0@lo:400:kworker.0 00000100:00080000:2.0:1788836636.528261:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 651 00000100:00080000:2.0:1788836636.528271:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788836636.528279:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a815f7e7000 using connection 192.168.201.144@tcp/0@lo 00000100:00100000:2.0:1788836636.528360:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a817f537480 x1875730518770304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788836636.528382:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788836636.528386:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788836636.528389:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a8158dbd800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788836636.528392:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 651 00000100:00080000:2.0:1788836636.528395:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788836636.528399:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a8158dbd800 using connection 192.168.201.144@tcp/0@lo 00000100:00100000:2.0:1788836636.528412:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a817f536680 x1875730518770432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788836636.528485:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788836636.528521:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f537800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875730518770560:0@lo:400:kworker.0 00000100:00100000:2.0:1788836636.528590:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836636.528651:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518770560 00000100:00100000:2.0:1788836636.528660:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518770560 00000100:00100000:2.0:1788836636.528705:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788836636.528715:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f535180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875730518770560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836636.528766:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f535180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875730518770560:12345-0@lo:400:kworker.0 Request processed in 52us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836636.528773:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788836636.528810:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a817f537800 x1875730518770560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836652 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836636.528823:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f537800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875730518770560:0@lo:400:kworker.0 00000100:00080000:2.0:1788836636.528862:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788836636.528865:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788836636.528867:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a8181a72800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788836636.528871:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 657 00000100:00080000:2.0:1788836636.528883:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788836636.528888:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9a8181a72800 using connection 192.168.201.144@tcp/0@lo 00000100:00100000:2.0:1788836636.528897:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f537800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875730518770688:0@lo:400:kworker.0 00000100:00100000:2.0:1788836636.528931:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836636.528970:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518770688 00000100:00100000:2.0:1788836636.528974:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518770688 00000100:00100000:2.0:1788836636.529004:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788836636.529011:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f535f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875730518770688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836636.529049:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f535f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875730518770688:12345-0@lo:400:kworker.0 Request processed in 38us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836636.529063:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788836636.529093:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f537800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875730518770688:0@lo:400:kworker.0 00000100:00100000:2.0:1788836636.529124:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a817f537800 x1875730518770816/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788836636.529133:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788836636.529136:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788836636.529165:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f535c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875730518770944:0@lo:400:kworker.0 00000100:00100000:2.0:1788836636.529195:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836636.529238:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518770944 00000100:00100000:2.0:1788836636.529242:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518770944 00000100:00100000:2.0:1788836636.529271:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788836636.529277:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f534e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875730518770944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836636.529312:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f534e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875730518770944:12345-0@lo:400:kworker.0 Request processed in 35us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836636.529318:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788836636.529350:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a817f535c00 x1875730518770944/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836652 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836636.529359:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f535c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875730518770944:0@lo:400:kworker.0 00000100:00080000:2.0:1788836636.529379:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788836636.529382:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788836636.530208:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f537480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875730518770304:0@lo:8:kworker.0 00000400:00000100:3.0:1788836636.530248:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875730518770304 offset 0 length 520: 4 00000100:00100000:3.0:1788836636.530276:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f536680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875730518770432:0@lo:8:kworker.0 00000400:00000100:3.0:1788836636.530291:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875730518770432 offset 0 length 520: 4 00000100:00100000:3.0:1788836636.530415:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f537800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875730518770816:0@lo:8:kworker.0 00000400:00000100:3.0:1788836636.530438:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875730518770816 offset 0 length 520: 4 00010000:00010000:2.0:1788836637.359394:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836637.542663:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875730518771072:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788836637.542790:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836637.542887:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788836627/real 1788836627] req@ffff9a8172d96300 x1875730518764160/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836637 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836637.542949:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a8172d96300 x1875730518764160/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836637 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788836637.542966:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9a80475ef000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788836637.542988:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788836637.542993:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875730518764160:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788836637.543062:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788836637.543067:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788836637.543070:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788836637.543074:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788836637.543097:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788836637.543100:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788836637.543103:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788836637.543106:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788836637.543109:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a80475ef000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788836637.543114:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 657 00000100:00080000:3.0:1788836637.543121:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788836637.543131:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a80475ef000 using connection 192.168.201.144@tcp/0@lo 00000100:00100000:3.0:1788836637.543161:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a804724e300 x1875730518771584/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788836637.543201:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a804724ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875730518771712:0@lo:400:kworker.0 00000100:00100000:3.0:1788836637.543235:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836637.543263:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788836637.543269:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a804724f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875730518771456:0@lo:400:kworker.0 00000100:00100000:3.0:1788836637.543297:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836637.543321:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a804724e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875730518771584:0@lo:8:kworker.0 00000400:00000100:3.0:1788836637.543347:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875730518771584 offset 0 length 520: 4 00000100:00100000:2.0:1788836637.543533:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a804724e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875730518771328:0@lo:400:kworker.0 00000100:00100000:2.0:1788836637.543568:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836637.543602:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788836637.543608:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a804724dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d9f3bec-9812-4f3e-be22-5440158bfa78:3621:1875730518771200:0@lo:400:kworker.0 00000100:00100000:2.0:1788836637.543640:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836637.543687:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518771712 00000100:00100000:2.0:1788836637.543706:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518771712 00000100:00100000:2.0:1788836637.543762:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518771328 00000100:00100000:2.0:1788836637.543766:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518771328 00000100:00100000:2.0:1788836637.543786:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788836637.543795:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a804724f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875730518771712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836637.543868:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a804724f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875730518771712:12345-0@lo:400:kworker.0 Request processed in 63us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836637.543877:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788836637.543897:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788836637.543903:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f535c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875730518771328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836637.543940:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f535c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875730518771328:12345-0@lo:400:kworker.0 Request processed in 37us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836637.543947:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788836637.543969:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518771072 00000100:00100000:2.0:1788836637.543972:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518771072 00000100:00100000:2.0:1788836637.543999:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518771456 00000100:00100000:2.0:1788836637.544001:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518771456 00000100:00100000:2.0:1788836637.544014:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788836637.544019:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a804724c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3619:x1875730518771072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788836637.544057:0:22760:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788836637.544093:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a804724c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3619:x1875730518771072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (1304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836637.544100:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788836637.544113:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788836637.544127:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a804724d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875730518771456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836637.544159:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a804724d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875730518771456:12345-0@lo:400:kworker.0 Request processed in 34us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836637.544165:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788836637.544214:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a804724f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875730518771456:0@lo:400:kworker.0 00010000:00080000:2.0:1788836637.544229:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a804724ce00 x1875730518771712/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836637.544240:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a804724ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875730518771712:0@lo:400:kworker.0 00000100:00100000:2.0:1788836637.544257:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875730518771072:0@lo:41:osp-pre-1-0.0 00010000:00080000:2.0:1788836637.544297:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a804724e680 x1875730518771328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836637.544306:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a804724e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875730518771328:0@lo:400:kworker.0 00000100:00100000:0.0:1788836637.544521:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875730518771840:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788836637.544559:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836637.544619:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518771200 00000100:00100000:0.0:1788836637.544625:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518771200 00000100:00100000:0.0:1788836637.544661:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788836637.544668:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814700f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+18:3621:x1875730518771200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836637.544716:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814700f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+18:3621:x1875730518771200:12345-0@lo:400:kworker.0 Request processed in 48us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836637.544724:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788836637.544978:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a804724dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d9f3bec-9812-4f3e-be22-5440158bfa78:3621:1875730518771200:0@lo:400:kworker.0 00000100:00100000:2.0:1788836637.544998:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518771840 00000100:00100000:2.0:1788836637.545002:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518771840 00000100:00100000:2.0:1788836637.545026:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788836637.545032:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a816bd74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875730518771840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788836637.545058:0:22760:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788836637.545099:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a816bd74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875730518771840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836637.545105:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788836637.545131:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875730518771840:0@lo:41:osp-pre-0-1.0 00000001:00100000:1.0:1788836638.074950:0:23490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788836638.373622:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788836639.405653:0:23516:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788836639.409546:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836640.443058:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836641.451067:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836642.474309:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836642.663137:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788836642.663164:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f535880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875730518771968:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788836642.663285:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836642.663373:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518771968 00000100:00100000:2.0:1788836642.663382:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518771968 00000100:00100000:2.0:1788836642.663438:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788836642.663447:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f536300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875730518771968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788836642.663735:0:22761:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788836642.663834:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f536300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875730518771968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 386us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836642.663841:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788836642.663936:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f535880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875730518771968:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788836642.665685:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875730518772096:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788836642.665762:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836642.666016:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518772096 00000100:00100000:0.0:1788836642.666026:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518772096 00000100:00100000:0.0:1788836642.666085:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788836642.666096:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f535880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875730518772096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788836642.666150:0:23498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788836642.666229:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f535880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875730518772096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 134us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836642.666236:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788836642.666434:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875730518772096:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1788836642.666746:0:16590:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788836642.666751:0:16590:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788836642.666754:0:16590:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788836642.666757:0:16590:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788836642.666789:0:16590:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788836642.666801:0:16590:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788836642.666804:0:16590:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788836642.666807:0:16590:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788836642.667060:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875730518772480:0@lo:400:kworker.0 00000100:00100000:1.0:1788836642.667108:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836642.667154:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788836642.667161:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875730518772352:0@lo:400:kworker.0 00000100:00100000:1.0:1788836642.667190:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836642.667232:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518772480 00000100:00100000:1.0:1788836642.667237:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518772480 00000100:00100000:1.0:1788836642.667275:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518772352 00000100:00100000:1.0:1788836642.667278:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518772352 00000100:00100000:1.0:1788836642.667293:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788836642.667299:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8172d97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875730518772480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836642.667342:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8172d97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875730518772480:12345-0@lo:400:kworker.0 Request processed in 42us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836642.667348:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788836642.667362:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788836642.667367:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8172d95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875730518772352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836642.667391:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8172d95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875730518772352:12345-0@lo:400:kworker.0 Request processed in 23us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836642.667396:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788836642.667416:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d9f3bec-9812-4f3e-be22-5440158bfa78:3619:1875730518772224:0@lo:400:kworker.0 00000100:00100000:1.0:1788836642.667446:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836642.667702:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518772224 00000100:00100000:1.0:1788836642.667708:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518772224 00000100:00100000:1.0:1788836642.667740:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788836642.667748:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814700cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+18:3619:x1875730518772224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836642.667797:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814700cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+18:3619:x1875730518772224:12345-0@lo:400:kworker.0 Request processed in 50us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836642.667804:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788836642.667862:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d9f3bec-9812-4f3e-be22-5440158bfa78:3619:1875730518772224:0@lo:400:kworker.0 00010000:00080000:1.0:1788836642.668358:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a816bd76300 x1875730518772352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836658 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836642.668370:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875730518772352:0@lo:400:kworker.0 00010000:00080000:1.0:1788836642.668380:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a816bd75c00 x1875730518772480/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836658 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836642.668389:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875730518772480:0@lo:400:kworker.0 00010000:00010000:0.0:1788836643.494069:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836644.519691:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788836644.845262:0:22791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:2.0:1788836644.906015:0:24259:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788836644.906019:0:24259:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788836644.906021:0:24259:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788836644.906149:0:24259:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a8180f72800 00000020:01000004:2.0:1788836644.906166:0:24259:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788836644.906180:0:24259:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788836644.906193:0:24259:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9a81642319b8) 00000020:00000080:2.0:1788836644.906211:0:24259:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788836644.982646:0:24259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788836644.997289:0:24259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788836644.998357:0:24259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788836644.998995:0:24259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788836644.999487:0:24259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788836645.000339:0:24259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1788836645.001291:0:24259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:0.0:1788836645.003284:0:24259:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788836645.003722:0:24259:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788836645.003747:0:24259:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788836645.003767:0:24259:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xbd163c73757161d8 00000020:01000004:0.0:1788836645.003777:0:24259:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788836645.003817:0:24259:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.144@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788836645.003821:0:24259:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.144@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788836645.003839:0:24259:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788836645.003845:0:24259:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788836645.003861:0:24259:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9a817f4d8000) 00000020:00000080:0.0:1788836645.003874:0:24259:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:0.0:1788836645.012159:0:24259:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788836645.012381:0:24259:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788836645.012388:0:24259:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788836645.016776:0:24259:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788836645.016797:0:24259:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788836645.035797:0:24259:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788836645.036064:0:24259:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788836645.052764:0:24259:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788836645.054714:0:24259:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788836645.054739:0:24259:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788836645.064303:0:24259:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788836645.064334:0:24259:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788836645.134692:0:24259:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788836645.135367:0:24259:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788836645.135375:0:24259:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788836645.139098:0:24259:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788836645.139115:0:24259:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788836645.140093:0:24259:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788836645.140100:0:24259:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788836645.148752:0:24259:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788836645.148925:0:24259:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788836645.148935:0:24259:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788836645.152150:0:24259:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788836645.152166:0:24259:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788836645.194841:0:24259:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788836645.195163:0:24259:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788836645.195170:0:24259:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788836645.197089:0:24259:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788836645.197104:0:24259:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788836645.197708:0:24259:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788836645.197747:0:24259:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1788836645.197753:0:24259:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.144@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788836645.210364:0:24259:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.144@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788836645.210514:0:24259:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.144@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1788836645.210519:0:24259:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788836645.210521:0:24259:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788836645.210523:0:24259:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788836645.210524:0:24259:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788836645.210525:0:24259:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788836645.210526:0:24259:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788836645.210528:0:24259:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788836645.210529:0:24259:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788836645.210530:0:24259:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788836645.210534:0:24259:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1788836645.210536:0:24259:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788836645.210537:0:24259:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788836645.210538:0:24259:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788836645.210539:0:24259:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788836645.210540:0:24259:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788836645.210541:0:24259:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788836645.210542:0:24259:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788836645.210543:0:24259:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788836645.210544:0:24259:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788836645.210571:0:24259:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788836645.210592:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f536d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:24259:1875730518772608:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788836645.210664:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836645.210770:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a815f62d900 going to sleep for 11 seconds 00000100:00100000:0.0:1788836645.210809:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518772608 00000100:00100000:0.0:1788836645.210817:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518772608 00000100:00100000:0.0:1788836645.210970:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788836645.210980:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814700ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+18:24259:x1875730518772608:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788836645.211015:0:22750:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788836645.211018:0:22750:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788836645.211023:0:22750:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788836645.211535:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814700ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+18:24259:x1875730518772608:12345-0@lo:253:mount.lustre.0 Request processed in 554us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836645.211551:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788836645.211721:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f536d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:24259:1875730518772608:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788836645.211750:0:24259:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788836645.211752:0:24259:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788836645.211754:0:24259:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788836645.211755:0:24259:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788836645.211756:0:24259:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788836645.211757:0:24259:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788836645.211758:0:24259:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788836645.211759:0:24259:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788836645.211760:0:24259:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788836645.211762:0:24259:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788836645.211781:0:24259:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a8180f72800 from lustre-OST0000 10000000:01000000:2.0:1788836645.211805:0:24259:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788836645.211808:0:24259:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788836645.211816:0:24259:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a815f6019b8 local copy 00010000:00010000:2.0:1788836645.211827:0:24259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a817f41a000/0xbd163c7375715f93 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375715f9a expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836645.211928:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f536d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:24259:1875730518772736:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788836645.211968:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836645.212028:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a815f62d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836645.212192:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518772736 00000100:00100000:0.0:1788836645.212197:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518772736 00000100:00100000:0.0:1788836645.212237:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788836645.212244:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814700f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+18:24259:x1875730518772736:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788836645.212358:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814700f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+18:24259:x1875730518772736:12345-0@lo:501:mount.lustre.0 Request processed in 114us (389us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788836645.212366:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788836645.212660:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f536d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:24259:1875730518772736:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788836645.212674:0:24259:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.144@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788836645.212695:0:24259:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.144@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788836645.212700:0:24259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a817f41a000/0xbd163c7375715f93 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375715f9a expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836645.212710:0:24259:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.144@tcp lock: ffff9a817f41a000/0xbd163c7375715f93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375715f9a expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836645.212744:0:24259:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a8180f72800 10000000:01000000:3.0:1788836645.212749:0:24259:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788836645.212755:0:24259:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788836645.212757:0:24259:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788836645.212761:0:24259:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788836645.212765:0:24259:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788836645.212788:0:24259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a80462e6a00/0xbd163c73757161e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836645.212804:0:24259:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.144@tcp lock: ffff9a80462e6a00/0xbd163c73757161e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836645.212814:0:24259:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.144@tcp lock: ffff9a80462e6a00/0xbd163c73757161e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836645.212828:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a804724d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:24259:1875730518772864:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788836645.212856:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836645.213034:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a816015c240 going to sleep for 11 seconds 00000100:00100000:0.0:1788836645.213126:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518772864 00000100:00100000:0.0:1788836645.213131:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518772864 00000100:00100000:0.0:1788836645.213187:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788836645.213194:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814700c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+18:24259:x1875730518772864:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788836645.213203:0:22750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836645.213222:0:22750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a804738da00/0xbd163c73757161ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd163c73757161e6 expref: -99 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836645.213243:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a804738da00/0xbd163c73757161ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd163c73757161e6 expref: 19 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836645.213253:0:22750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a804738da00/0xbd163c73757161ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd163c73757161e6 expref: 19 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836645.213261:0:22750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a804738da00, rc 0) 00000100:00100000:0.0:1788836645.213297:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814700c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+19:24259:x1875730518772864:12345-0@lo:101:mount.lustre.0 Request processed in 104us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836645.213304:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788836645.213366:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a804724d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:24259:1875730518772864:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788836645.213389:0:24259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.144@tcp lock: ffff9a80462e6a00/0xbd163c73757161e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c73757161ed expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836645.213398:0:24259:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.144@tcp lock: ffff9a80462e6a00/0xbd163c73757161e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd163c73757161ed expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788836645.214612:0:24259:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:3.0:1788836645.215276:0:24259:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788836645.219291:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1788836645.219363:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1788836645.219448:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1788836645.219591:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1788836645.219607:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1788836645.219618:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1788836645.219630:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1788836645.219641:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1788836645.219653:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:1.0:1788836645.219664:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:1.0:1788836645.219675:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:1.0:1788836645.219687:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:1.0:1788836645.219712:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:1.0:1788836645.219719:0:24259:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:1.0:1788836645.219840:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d96680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:24259:1875730518772992:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788836645.220021:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836645.220122:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a81412ed000 going to sleep for 11 seconds 00000100:00100000:0.0:1788836645.220269:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518772992 00000100:00100000:0.0:1788836645.220284:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518772992 00000100:00100000:0.0:1788836645.220370:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788836645.220389:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814700e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+19:24259:x1875730518772992:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788836645.220640:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814700e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+19:24259:x1875730518772992:12345-0@lo:501:mount.lustre.0 Request processed in 261us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836645.220647:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788836645.220723:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d96680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:24259:1875730518772992:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788836645.220766:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d96680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:24259:1875730518773120:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788836645.220799:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836645.220936:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a81412ed000 going to sleep for 11 seconds 00000100:00100000:2.0:1788836645.221083:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518773120 00000100:00100000:2.0:1788836645.221088:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518773120 00000100:00100000:2.0:1788836645.221110:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788836645.221115:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814700e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+19:24259:x1875730518773120:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788836645.223176:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814700e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+19:24259:x1875730518773120:12345-0@lo:503:mount.lustre.0 Request processed in 2053us (2368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836645.223189:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788836645.223354:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d96680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:24259:1875730518773120:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788836645.223841:0:24259:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788836645.224098:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d96680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:24259:1875730518773248:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788836645.224143:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836645.224250:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a81412ed000 going to sleep for 11 seconds 00000100:00100000:3.0:1788836645.227097:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518773248 00000100:00100000:3.0:1788836645.227113:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518773248 00000100:00100000:0.0:1788836645.227694:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788836645.229538:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814700d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+19:24259:x1875730518773248:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788836645.231158:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814700d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+19:24259:x1875730518773248:12345-0@lo:502:mount.lustre.0 Request processed in 3448us (7008us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836645.231183:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788836645.231425:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d96680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:24259:1875730518773248:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788836645.231776:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1788836645.231818:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1788836645.231833:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1788836645.231845:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1788836645.231857:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1788836645.231870:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1788836645.231883:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1788836645.231911:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1788836645.231925:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:3.0:1788836645.231938:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:3.0:1788836645.231965:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:3.0:1788836645.231982:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:3.0:1788836645.232022:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a804724d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:24259:1875730518773376:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788836645.232071:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836645.232108:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a816015c480 going to sleep for 11 seconds 00000100:00100000:2.0:1788836645.232560:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518773376 00000100:00100000:2.0:1788836645.232567:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518773376 00000100:00100000:2.0:1788836645.232608:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788836645.232617:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814700dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+19:24259:x1875730518773376:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788836645.232712:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814700dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+19:24259:x1875730518773376:12345-0@lo:502:mount.lustre.0 Request processed in 96us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836645.232719:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788836645.233102:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a804724d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:24259:1875730518773376:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788836645.233150:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:3.0:1788836645.233159:0:24259:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1788836645.235174:0:24276:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788836645.235185:0:24276:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1788836645.235192:0:24276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836645.235194:0:24276:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788836645.235201:0:24276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788836645.235278:0:24276:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9a8164234d28) 00000020:00000080:2.0:1788836645.235305:0:24276:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788836645.235312:0:24276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788836645.235442:0:24276:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a8180f72800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788836645.235453:0:24276:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788836645.235523:0:24276:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xbd163c73757161fb 00010000:00010000:2.0:1788836645.250761:0:24276:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1788836645.252206:0:24276:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:2.0:1788836645.262036:0:24276:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:0.0:1788836645.281609:0:24276:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788836645.281624:0:24276:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788836645.281631:0:24276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836645.281633:0:24276:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788836645.281637:0:24276:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788836645.281640:0:24276:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:0.0:1788836645.281642:0:24276:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788836645.281644:0:24276:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788836645.281645:0:24276:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788836645.281648:0:24276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836645.281649:0:24276:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788836645.281652:0:24276:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788836645.281655:0:24276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836645.281656:0:24276:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788836645.281659:0:24276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788836645.281661:0:24276:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788836645.281664:0:24276:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788836645.281666:0:24276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836645.281667:0:24276:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788836645.281669:0:24276:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788836645.281671:0:24276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836645.281672:0:24276:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788836645.281676:0:24276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788836645.281709:0:24276:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788836645.281712:0:24276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836645.281714:0:24276:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788836645.281733:0:24276:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:0.0:1788836645.288529:0:24259:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1788836645.288581:0:24259:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.144@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788836645.288604:0:24259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a80462e6a00/0xbd163c73757161e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c73757161ed expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836645.288616:0:24259:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.144@tcp lock: ffff9a80462e6a00/0xbd163c73757161e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c73757161ed expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836645.288637:0:24259:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a8180f72800 from 1 10000000:01000000:0.0:1788836645.288641:0:24259:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788836645.288679:0:24259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a804738c800/0xbd163c7375716202 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836645.288687:0:24259:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.144@tcp lock: ffff9a804738c800/0xbd163c7375716202 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836645.288698:0:24259:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.144@tcp lock: ffff9a804738c800/0xbd163c7375716202 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836645.288731:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd76a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:24259:1875730518773504:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788836645.288816:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836645.288856:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a804760c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836645.289931:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518773504 00000100:00100000:3.0:1788836645.289943:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518773504 00000100:00100000:3.0:1788836645.290130:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788836645.290140:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814700c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+19:24259:x1875730518773504:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788836645.290157:0:22749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836645.290171:0:22749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a80462e7000/0xbd163c7375716209 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd163c7375716202 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836645.290197:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a80462e7000/0xbd163c7375716209 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd163c7375716202 expref: 20 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836645.290207:0:22749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a80462e7000/0xbd163c7375716209 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd163c7375716202 expref: 20 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836645.290225:0:22749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a80462e7000, rc 0) 00000100:00100000:3.0:1788836645.290282:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814700c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+20:24259:x1875730518773504:12345-0@lo:101:mount.lustre.0 Request processed in 144us (1466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836645.290289:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788836645.291526:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd76a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:24259:1875730518773504:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788836645.291549:0:24259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.144@tcp lock: ffff9a804738c800/0xbd163c7375716202 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375716209 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836645.291559:0:24259:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.144@tcp lock: ffff9a804738c800/0xbd163c7375716202 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd163c7375716209 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788836645.308427:0:24259:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:0.0:1788836645.308791:0:24259:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788836645.309031:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1788836645.309057:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1788836645.309072:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1788836645.309086:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1788836645.309100:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1788836645.309112:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1788836645.309127:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1788836645.309141:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:0.0:1788836645.309172:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1788836645.309189:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:0.0:1788836645.309201:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:0.0:1788836645.312267:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:0.0:1788836645.312295:0:24259:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:0.0:1788836645.312412:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd76a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:24259:1875730518773632:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788836645.312508:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836645.312557:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a804760c540 going to sleep for 11 seconds 00000100:00100000:1.0:1788836645.315361:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518773632 00000100:00100000:1.0:1788836645.315374:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518773632 00000100:00100000:1.0:1788836645.315437:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788836645.315459:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814700d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+20:24259:x1875730518773632:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788836645.315675:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814700d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+20:24259:x1875730518773632:12345-0@lo:501:mount.lustre.0 Request processed in 217us (3166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836645.315683:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788836645.316536:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd76a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:24259:1875730518773632:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788836645.316587:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd76a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:24259:1875730518773760:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788836645.317053:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836645.317149:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a804760c540 going to sleep for 11 seconds 00000100:00100000:2.0:1788836645.317224:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518773760 00000100:00100000:2.0:1788836645.317231:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518773760 00000100:00100000:2.0:1788836645.317274:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788836645.317282:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814700c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+20:24259:x1875730518773760:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788836645.317575:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814700c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+20:24259:x1875730518773760:12345-0@lo:503:mount.lustre.0 Request processed in 293us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836645.317591:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788836645.318245:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd76a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:24259:1875730518773760:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788836645.319348:0:24259:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788836645.319853:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd76a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:24259:1875730518773888:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788836645.320618:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836645.326543:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a804760c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836645.336775:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518773888 00000100:00100000:1.0:1788836645.336793:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518773888 00000100:00100000:1.0:1788836645.336862:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788836645.336873:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814700e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+20:24259:x1875730518773888:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788836645.337511:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814700e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+20:24259:x1875730518773888:12345-0@lo:502:mount.lustre.0 Request processed in 637us (16891us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836645.337519:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788836645.343635:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd76a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:24259:1875730518773888:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788836645.344068:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1788836645.344112:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1788836645.344128:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1788836645.344141:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1788836645.344154:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1788836645.344169:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1788836645.344182:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1788836645.344226:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1788836645.344245:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1788836645.344259:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1788836645.344272:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1788836645.344314:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f534000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:24259:1875730518774016:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788836645.344389:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836645.344425:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8158908f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788836645.345411:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518774016 00000100:00100000:1.0:1788836645.345422:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518774016 00000100:00100000:1.0:1788836645.345515:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788836645.345526:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814700d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+20:24259:x1875730518774016:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788836645.345657:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814700d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+20:24259:x1875730518774016:12345-0@lo:502:mount.lustre.0 Request processed in 134us (1268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836645.345665:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788836645.348408:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f534000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:24259:1875730518774016:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788836645.348553:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1788836645.348571:0:24259:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788836645.357115:0:24280:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788836645.357129:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836645.357131:0:24280:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788836645.357139:0:24280:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a8180f72800 00000020:00000080:0.0:1788836645.357142:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788836645.357151:0:24280:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788836645.357154:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836645.357155:0:24280:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788836645.357158:0:24280:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788836645.357160:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836645.357161:0:24280:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788836645.357165:0:24280:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a8180f72800 00000020:00000080:0.0:1788836645.357166:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788836645.357235:0:24280:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788836645.357240:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836645.357241:0:24280:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788836645.357243:0:24280:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788836645.357245:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836645.357246:0:24280:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788836645.357249:0:24280:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a8180f72800 00000020:00000080:0.0:1788836645.357251:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788836645.357267:0:24280:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788836645.357270:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836645.357272:0:24280:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788836645.357273:0:24280:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788836645.357276:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836645.357277:0:24280:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788836645.357280:0:24280:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a8180f72800 00000020:00000080:0.0:1788836645.357281:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788836645.357299:0:24280:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788836645.357301:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788836645.357311:0:24280:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788836645.357314:0:24280:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:2.0:1788836645.357529:0:24259:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788836645.357563:0:24259:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788836645.357579:0:24259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a804738c800/0xbd163c7375716202 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375716209 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836645.357591:0:24259:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.144@tcp lock: ffff9a804738c800/0xbd163c7375716202 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375716209 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836645.357638:0:24259:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788836645.357641:0:24259:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a8180f72800 10000000:01000000:2.0:1788836645.357644:0:24259:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a8180f72800 10000000:01000000:2.0:1788836645.357653:0:24259:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788836645.357659:0:24259:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a8180f72800 from 1 10000000:01000000:2.0:1788836645.357662:0:24259:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788836645.357705:0:24259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a8167974200/0xbd163c7375716210 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836645.357714:0:24259:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.144@tcp lock: ffff9a8167974200/0xbd163c7375716210 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836645.357734:0:24259:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.144@tcp lock: ffff9a8167974200/0xbd163c7375716210 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836645.357761:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f534000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:24259:1875730518774144:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788836645.357827:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836645.357867:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8158908480 going to sleep for 11 seconds 00000100:00100000:0.0:1788836645.361558:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518774144 00000100:00100000:0.0:1788836645.361572:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518774144 00000100:00100000:0.0:1788836645.361630:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788836645.361639:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8158daf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+20:24259:x1875730518774144:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788836645.361656:0:22749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836645.361673:0:22749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a804738dc00/0xbd163c7375716217 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd163c7375716210 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836645.361698:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a804738dc00/0xbd163c7375716217 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd163c7375716210 expref: 21 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836645.361709:0:22749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a804738dc00/0xbd163c7375716217 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd163c7375716210 expref: 21 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836645.361719:0:22749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a804738dc00, rc 0) 00000100:00100000:0.0:1788836645.361802:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8158daf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+21:24259:x1875730518774144:12345-0@lo:101:mount.lustre.0 Request processed in 163us (3974us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836645.361809:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788836645.364785:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f534000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:24259:1875730518774144:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788836645.364815:0:24259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.144@tcp lock: ffff9a8167974200/0xbd163c7375716210 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375716217 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836645.364828:0:24259:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.144@tcp lock: ffff9a8167974200/0xbd163c7375716210 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd163c7375716217 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788836645.378966:0:24259:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:0.0:1788836645.379289:0:24259:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788836645.379491:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1788836645.379514:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1788836645.379527:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1788836645.379537:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1788836645.379550:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1788836645.379563:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1788836645.379574:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1788836645.379586:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1788836645.379600:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1788836645.379635:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1788836645.379648:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1788836645.379660:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1788836645.379671:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1788836645.379683:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1788836645.379694:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1788836645.379705:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1788836645.379717:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1788836645.379744:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1788836645.379758:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1788836645.379770:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1788836645.379795:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1788836645.379811:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1788836645.379822:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1788836645.379835:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1788836645.379847:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:0.0:1788836645.379874:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:0.0:1788836645.379888:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:0.0:1788836645.379902:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:0.0:1788836645.379916:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:0.0:1788836645.379929:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:0.0:1788836645.379942:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:0.0:1788836645.379954:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:0.0:1788836645.379965:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:0.0:1788836645.379977:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:0.0:1788836645.379989:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:0.0:1788836645.380002:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:0.0:1788836645.380014:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:0.0:1788836645.380026:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:0.0:1788836645.380037:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:0.0:1788836645.380049:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:0.0:1788836645.380062:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:0.0:1788836645.380088:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:0.0:1788836645.380108:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:0.0:1788836645.380119:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:0.0:1788836645.380130:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:0.0:1788836645.380140:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:0.0:1788836645.380152:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:0.0:1788836645.380165:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:0.0:1788836645.380272:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:0.0:1788836645.380293:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:0.0:1788836645.380312:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:0.0:1788836645.380317:0:24259:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:0.0:1788836645.380399:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd76a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:24259:1875730518774272:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788836645.380480:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836645.380522:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a804760c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836645.386415:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518774272 00000100:00100000:3.0:1788836645.386431:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518774272 00000100:00100000:3.0:1788836645.386527:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788836645.386538:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8158dad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+21:24259:x1875730518774272:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788836645.386757:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8158dad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+21:24259:x1875730518774272:12345-0@lo:501:mount.lustre.0 Request processed in 220us (6276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836645.386766:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788836645.393367:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd76a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:24259:1875730518774272:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788836645.393429:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd76a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:24259:1875730518774400:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788836645.393518:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836645.393551:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518774400 00000100:00100000:0.0:1788836645.393552:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a804760c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836645.393557:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518774400 00000100:00100000:1.0:1788836645.393605:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788836645.393614:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f415450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+21:24259:x1875730518774400:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788836645.393754:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f415450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+21:24259:x1875730518774400:12345-0@lo:503:mount.lustre.0 Request processed in 140us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836645.393763:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788836645.398691:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd76a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:24259:1875730518774400:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788836645.399426:0:24259:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788836645.399534:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd76a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:24259:1875730518774528:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788836645.399610:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836645.399674:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a804760c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836645.401667:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518774528 00000100:00100000:1.0:1788836645.404500:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518774528 00000100:00100000:1.0:1788836645.405968:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788836645.405979:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f414850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+21:24259:x1875730518774528:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788836645.406169:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f414850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+21:24259:x1875730518774528:12345-0@lo:502:mount.lustre.0 Request processed in 191us (6557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836645.406176:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788836645.408841:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd76a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:24259:1875730518774528:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788836645.409383:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1788836645.409417:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1788836645.409452:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1788836645.409491:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1788836645.409518:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1788836645.409532:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1788836645.409545:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1788836645.409558:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1788836645.409572:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1788836645.409585:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1788836645.409597:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1788836645.409610:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1788836645.409623:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1788836645.409654:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1788836645.409667:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1788836645.409680:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1788836645.409694:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1788836645.409707:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1788836645.409745:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1788836645.409763:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1788836645.409776:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1788836645.409806:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1788836645.409821:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1788836645.409835:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1788836645.409850:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:0.0:1788836645.409864:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:0.0:1788836645.409878:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:0.0:1788836645.409905:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:0.0:1788836645.409921:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:0.0:1788836645.409936:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:0.0:1788836645.418238:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:0.0:1788836645.418286:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:0.0:1788836645.418300:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:0.0:1788836645.418312:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:0.0:1788836645.418345:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:0.0:1788836645.418361:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:0.0:1788836645.418373:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:0.0:1788836645.418395:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:0.0:1788836645.418407:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:0.0:1788836645.418421:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:0.0:1788836645.418434:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:0.0:1788836645.418448:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:0.0:1788836645.418479:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:0.0:1788836645.418496:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:0.0:1788836645.418510:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:0.0:1788836645.418524:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:0.0:1788836645.418539:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:0.0:1788836645.418554:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:0.0:1788836645.418612:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd76a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:24259:1875730518774656:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788836645.418690:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836645.418746:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a804760c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836645.427913:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518774656 00000100:00100000:3.0:1788836645.427931:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518774656 00000100:00100000:3.0:1788836645.428065:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788836645.428077:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f414c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+21:24259:x1875730518774656:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788836645.429059:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f414c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+21:24259:x1875730518774656:12345-0@lo:502:mount.lustre.0 Request processed in 981us (10366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836645.429069:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788836645.443617:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd76a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:24259:1875730518774656:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788836645.444296:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:0.0:1788836645.444344:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:0.0:1788836645.444385:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd76a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:24259:1875730518774784:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788836645.444449:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836645.444520:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a804760c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836645.448020:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518774784 00000100:00100000:1.0:1788836645.448036:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518774784 00000100:00100000:1.0:1788836645.448108:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788836645.448119:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f417450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+21:24259:x1875730518774784:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788836645.448294:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f417450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+21:24259:x1875730518774784:12345-0@lo:502:mount.lustre.0 Request processed in 177us (3845us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836645.448302:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788836645.448700:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd76a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:24259:1875730518774784:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788836645.448800:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:0.0:1788836645.448815:0:24259:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788836645.451332:0:24285:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788836645.451346:0:24285:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9a81679419b8) 00000020:00000080:1.0:1788836645.451370:0:24285:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1788836645.451486:0:24285:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a8180f72800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788836645.451490:0:24285:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a8180f72800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788836645.451493:0:24285:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8180f72800 3 00010000:00080000:1.0:1788836645.451537:0:24285:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a804661b000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.144@tcp at head 00010000:00010000:1.0:1788836645.459706:0:24285:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1788836645.464714:0:24285:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788836645.464788:0:24285:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788836645.464803:0:24285:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xbd163c7375716225 00000100:00080000:1.0:1788836645.464814:0:24285:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788836645.464820:0:24285:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a804661b000 using connection 192.168.201.144@tcp/0@lo 00000100:00100000:1.0:1788836645.464857:0:24285:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8172d95880 x1875730518774912/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788836645.469881:0:24285:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788836645.470705:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3617:1875730518774912:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788836645.470790:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788836645.471044:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788836645.471049:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788836645.471052:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788836645.471055:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788836645.471079:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788836645.471094:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788836645.471097:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788836645.471100:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788836645.471130:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f537b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875730518775296:0@lo:400:kworker.0 00000100:00100000:2.0:1788836645.471162:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836645.471184:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788836645.471190:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f536d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875730518775424:0@lo:400:kworker.0 00000100:00100000:2.0:1788836645.471222:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836645.471253:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518775296 00000100:00100000:2.0:1788836645.471260:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518775296 00000100:00100000:1.0:1788836645.471276:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518774912 00000100:00100000:1.0:1788836645.471280:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518774912 00000100:00100000:1.0:1788836645.471296:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518775424 00000100:00100000:2.0:1788836645.471298:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788836645.471298:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518775424 00000100:00100000:2.0:1788836645.471305:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166d89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875730518775296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836645.471314:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788836645.471320:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166d8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875730518775424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836645.475126:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f534000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875730518775040:0@lo:400:kworker.0 00000100:00100000:2.0:1788836645.496593:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166d89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875730518775296:12345-0@lo:400:kworker.0 Request processed in 25277us (25419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836645.496609:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1788836645.501789:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a817f536d80 x1875730518775424/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836645.501809:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f536d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875730518775424:0@lo:400:kworker.0 00000100:00100000:2.0:1788836645.501822:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f537b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875730518775296:0@lo:400:kworker.0 00000100:00100000:2.0:1788836645.501868:0:22755:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788836645.501878:0:22755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788836645.501902:0:22754:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788836645.501915:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788836645.501922:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a816bd76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3617:x1875730518774912:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788836645.501950:0:22754:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 675 last 0 00000020:00000080:2.0:1788836645.502011:0:22754:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xbd163c737571622c 00000004:00100000:2.0:1788836645.502029:0:22754:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788836645.502061:0:22754:0:(import.c:65:import_set_state_nolock()) ffff9a804743a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788836645.502075:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166d8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875730518775424:12345-0@lo:400:kworker.0 Request processed in 30745us (30842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836645.502085:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788836645.502143:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a816bd76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875730518774912:12345-0@lo:38:llog_process_th.0 Request processed in 220us (31352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836645.502150:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788836645.502182:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f534700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875730518775168:0@lo:400:kworker.0 00010000:00080000:1.0:1788836645.502212:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8172d95880 x1875730518774912/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788836655 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836645.502222:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788836645.502227:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1788836645.502235:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788836645.502239:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788836645.502241:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9a804661b000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788836645.502246:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3617:1875730518774912:0@lo:38:llog_process_th.0 00000020:01000004:3.0:1788836645.512162:0:24285:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788836645.512181:0:24285:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9a816c10cd28) 00000020:00000080:3.0:1788836645.512207:0:24285:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1788836645.512297:0:24285:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a8180f72800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788836645.512302:0:24285:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a8180f72800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788836645.512304:0:24285:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8180f72800 3 00010000:00080000:3.0:1788836645.512335:0:24285:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a8047df4800@lustre-MDT0001-lwp-OST0000: add connection 192.168.201.144@tcp at head 00010000:00010000:3.0:1788836645.521892:0:24285:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1788836645.522097:0:24285:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1788836645.522172:0:24285:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788836645.522187:0:24285:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xbd163c737571623a 00000100:00080000:3.0:1788836645.522198:0:24285:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788836645.522204:0:24285:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9a8047df4800 using connection 192.168.201.144@tcp/0@lo 00000100:00100000:3.0:1788836645.522250:0:24285:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a804724d880 x1875730518775552/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788836645.522276:0:24285:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788836645.522311:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788836645.522315:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788836645.522317:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788836645.522320:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788836645.522323:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788836645.522326:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788836645.522328:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788836645.522331:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788836645.523654:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836645.527032:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836645.529385:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518775168 00000100:00100000:3.0:1788836645.529399:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518775168 00000100:00100000:3.0:1788836645.529482:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788836645.529493:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166d88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875730518775168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836645.529846:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166d88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875730518775168:12345-0@lo:400:kworker.0 Request processed in 354us (6195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836645.529854:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788836645.532385:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a804724d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3617:1875730518775552:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788836645.532489:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1788836645.532691:0:24285:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000100:00100000:3.0:1788836645.533029:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518775552 00000100:00100000:3.0:1788836645.533039:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518775552 00000100:00100000:3.0:1788836645.533078:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788836645.533086:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8172d95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3617:x1875730518775552:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788836645.533119:0:22755:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 675 last 0 00000020:00000080:3.0:1788836645.533167:0:22755:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xbd163c7375716241 00000004:00100000:3.0:1788836645.533181:0:22755:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788836645.533221:0:22755:0:(import.c:65:import_set_state_nolock()) ffff9a8047df2800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788836645.533276:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8172d95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875730518775552:12345-0@lo:38:llog_process_th.0 Request processed in 190us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836645.533284:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000000:0.0:1788836645.533591:0:24259:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788836645.533636:0:24259:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788836645.533654:0:24259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a8167974200/0xbd163c7375716210 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375716217 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836645.533665:0:24259:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.144@tcp lock: ffff9a8167974200/0xbd163c7375716210 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375716217 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788836645.533731:0:24259:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788836645.533734:0:24259:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788836645.533735:0:24259:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788836645.533737:0:24259:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788836645.533738:0:24259:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788836645.533739:0:24259:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788836645.533741:0:24259:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788836645.533744:0:24259:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788836645.533745:0:24259:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788836645.533750:0:24259:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1788836645.533752:0:24259:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788836645.533754:0:24259:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788836645.533755:0:24259:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788836645.533756:0:24259:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788836645.533757:0:24259:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788836645.533758:0:24259:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788836645.533759:0:24259:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788836645.533760:0:24259:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788836645.533761:0:24259:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788836645.533782:0:24259:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788836645.533799:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd75c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:24259:1875730518775680:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788836645.533837:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836645.533860:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a804760c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836645.538083:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518775680 00000100:00100000:3.0:1788836645.538099:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518775680 00000100:00100000:3.0:1788836645.538160:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788836645.538171:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f415c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+21:24259:x1875730518775680:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788836645.538205:0:22749:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788836645.538221:0:22749:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:1.0:1788836645.543243:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a804724d880 x1875730518775552/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788836655 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836645.543259:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788836645.543271:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1788836645.543295:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788836645.543301:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788836645.543305:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9a8047df4800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788836645.543312:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a804724d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3617:1875730518775552:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788836645.546920:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518775040 00000100:00100000:2.0:1788836645.546941:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518775040 00000100:00100000:2.0:1788836645.547006:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788836645.547018:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a816bd74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875730518775040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836645.547116:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a816bd74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875730518775040:12345-0@lo:400:kworker.0 Request processed in 100us (20088us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836645.547123:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1788836645.547185:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a817f534700 x1875730518775168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836645.547198:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f534700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875730518775168:0@lo:400:kworker.0 00000100:00100000:0.0:1788836645.548182:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f534000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875730518775040:0@lo:400:kworker.0 00010000:00010000:0.0:1788836645.548249:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:2.0:1788836645.557879:0:22749:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788836645.557899:0:22749:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788836645.558072:0:22771:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788836645.558077:0:22771:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788836645.558098:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a80462e7600/0xbd163c7375716248 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836645.558118:0:22771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a804738d400/0xbd163c7375716192 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd163c737571618b expref: 21 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836645.558127:0:22771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a804738cc00/0xbd163c73757161a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd163c7375716199 expref: 21 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836645.558134:0:22771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a80462e7600/0xbd163c7375716248 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836645.558184:0:22771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a804738cc00/0xbd163c73757161a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd163c7375716199 expref: 21 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836645.558199:0:22771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a804738cc00/0xbd163c73757161a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd163c7375716199 expref: 21 pid: 22750 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836645.558222:0:22771:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a804724d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22771:1875730518775808:0@lo:104: 00000100:00100000:3.0:1788836645.558267:0:22771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836645.558268:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f415c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+21:24259:x1875730518775680:12345-0@lo:253:mount.lustre.0 Request processed in 20097us (24428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836645.558278:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00010000:3.0:1788836645.558305:0:22771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a804738d400/0xbd163c7375716192 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd163c737571618b expref: 20 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836645.558313:0:22771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a804738d400/0xbd163c7375716192 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd163c737571618b expref: 20 pid: 22748 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836645.558321:0:22771:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a804724c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22771:1875730518775936:0@lo:104: 00000100:00100000:3.0:1788836645.558344:0:22771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836645.558380:0:22771:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a80475f0780 going to sleep for 11 seconds 00000100:00100000:3.0:1788836645.558403:0:22738:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788836645.558417:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518775808 00000100:00100000:3.0:1788836645.558423:0:22738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518775808 00000100:00100000:3.0:1788836645.558450:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518775936 00000100:00100000:3.0:1788836645.558453:0:22738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518775936 00000100:00100000:3.0:1788836645.558496:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788836645.558514:0:22738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a804724df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d9f3bec-9812-4f3e-be22-5440158bfa78+4:22771:x1875730518775808:12345-0@lo:104: 00010000:00010000:3.0:1788836645.558526:0:22738:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.144@tcp lock: ffff9a8167975400/0xbd163c7375716199 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd163c73757161a0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836645.558567:0:22738:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788836645.558572:0:22738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a804724df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d9f3bec-9812-4f3e-be22-5440158bfa78+4:22771:x1875730518775808:12345-0@lo:104: Request processed in 70us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836645.558578:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788836645.558593:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788836645.558599:0:22738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a804761b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d9f3bec-9812-4f3e-be22-5440158bfa78+3:22771:x1875730518775936:12345-0@lo:104: 00010000:00010000:3.0:1788836645.558605:0:22738:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.144@tcp lock: ffff9a80462e6200/0xbd163c737571618b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd163c7375716192 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836645.558660:0:22738:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788836645.558665:0:22738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a804761b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d9f3bec-9812-4f3e-be22-5440158bfa78+3:22771:x1875730518775936:12345-0@lo:104: Request processed in 68us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836645.558929:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1788836645.558983:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788836645.558991:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.144@tcp lock: ffff9a8167975400/0xbd163c7375716199 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd163c73757161a0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836645.558999:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8167975400 already unused, calling callback (ffffffffc139ec20) 10000000:00010000:3.0:1788836645.559003:0:22744:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.144@tcp lock: ffff9a8167975400/0xbd163c7375716199 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd163c73757161a0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836645.559012:0:22744:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.144@tcp lock: ffff9a8167975400/0xbd163c7375716199 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd163c73757161a0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788836645.559021:0:22744:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.144@tcp lock: ffff9a8167975400/0xbd163c7375716199 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd163c73757161a0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836645.559026:0:22744:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788836645.559059:0:22744:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.144@tcp lock: ffff9a8167975400/0xbd163c7375716199 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd163c73757161a0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836645.559066:0:22744:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788836645.560268:0:22771:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a804724d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22771:1875730518775808:0@lo:104: 00000100:00100000:2.0:1788836645.560278:0:22771:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a804724c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22771:1875730518775936:0@lo:104: 00010000:00010000:2.0:1788836645.560302:0:22771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a80462e7600/0xbd163c7375716248 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836645.561294:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.144@tcp lock: ffff9a8167975400/0xbd163c7375716199 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd163c73757161a0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836645.561306:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.144@tcp lock: ffff9a8167975400/0xbd163c7375716199 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd163c73757161a0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836645.561331:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836645.561335:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.144@tcp lock: ffff9a80462e6200/0xbd163c737571618b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd163c7375716192 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836645.561342:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a80462e6200 already unused, calling callback (ffffffffc139ec20) 10000000:00010000:3.0:1788836645.561346:0:22744:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.144@tcp lock: ffff9a80462e6200/0xbd163c737571618b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd163c7375716192 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836645.562907:0:22744:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.144@tcp lock: ffff9a80462e6200/0xbd163c737571618b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd163c7375716192 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788836645.562929:0:22744:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.144@tcp lock: ffff9a80462e6200/0xbd163c737571618b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd163c7375716192 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836645.562935:0:22744:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788836645.562981:0:22744:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.144@tcp lock: ffff9a80462e6200/0xbd163c737571618b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd163c7375716192 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836645.562986:0:22744:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788836645.563000:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.144@tcp lock: ffff9a80462e6200/0xbd163c737571618b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd163c7375716192 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836645.563007:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.144@tcp lock: ffff9a80462e6200/0xbd163c737571618b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd163c7375716192 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836645.563027:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836645.563029:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836645.563033:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836645.563048:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836645.563084:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a804724df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d9f3bec-9812-4f3e-be22-5440158bfa78:3618:1875730518776064:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788836645.563164:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836645.563982:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788836645.563992:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a804724f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d9f3bec-9812-4f3e-be22-5440158bfa78:3618:1875730518776192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788836645.564029:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836645.564083:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518776064 00000100:00100000:3.0:1788836645.564091:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518776064 00010000:00010000:3.0:1788836645.564121:0:22741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a804738cc00/0xbd163c73757161a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd163c7375716199 expref: 21 pid: 22750 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836645.564855:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518776192 00000100:00100000:3.0:1788836645.564861:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518776192 00010000:00010000:3.0:1788836645.564880:0:22741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a804738d400/0xbd163c7375716192 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd163c737571618b expref: 22 pid: 22748 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836645.564908:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788836645.564917:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a804724c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d9f3bec-9812-4f3e-be22-5440158bfa78+22:3618:x1875730518776064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788836645.564932:0:22741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836645.564938:0:22741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a804738cc00/0xbd163c73757161a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd163c7375716199 expref: 22 pid: 22750 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836645.564949:0:22741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a804738cc00/0xbd163c73757161a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd163c7375716199 expref: 22 pid: 22750 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836645.564963:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a804738cc00/0xbd163c73757161a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd163c7375716199 expref: 22 pid: 22750 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836645.564977:0:22741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836645.565025:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a804724c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d9f3bec-9812-4f3e-be22-5440158bfa78+21:3618:x1875730518776064:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (1861us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836645.565046:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788836645.565064:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788836645.565070:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8041422c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d9f3bec-9812-4f3e-be22-5440158bfa78+20:3618:x1875730518776192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788836645.565078:0:22741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836645.565082:0:22741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a804738d400/0xbd163c7375716192 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd163c737571618b expref: 20 pid: 22748 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836645.565090:0:22741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a804738d400/0xbd163c7375716192 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd163c737571618b expref: 20 pid: 22748 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836645.565099:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a804738d400/0xbd163c7375716192 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd163c737571618b expref: 20 pid: 22748 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836645.565110:0:22741:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a80462e7600/0xbd163c7375716248 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836645.565118:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a80462e7600/0xbd163c7375716248 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788836645.565133:0:22741:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007056197s 00010000:00010000:3.0:1788836645.565137:0:22741:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a80462e7600/0xbd163c7375716248 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836645.565332:0:22741:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a80462e7600/0xbd163c7375716248 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836645.565339:0:22741:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a80462e7600/0xbd163c7375716248 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836645.565346:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a80462e7600/0xbd163c7375716248 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836645.566095:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a80462e7600 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:3.0:1788836645.566100:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a80462e7600/0xbd163c7375716248 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836645.566108:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a80462e7600/0xbd163c7375716248 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836645.567294:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd75c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:24259:1875730518775680:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788836645.567323:0:24259:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788836645.567326:0:24259:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788836645.567328:0:24259:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788836645.567329:0:24259:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788836645.567330:0:24259:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788836645.567331:0:24259:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788836645.567332:0:24259:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788836645.567333:0:24259:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788836645.567335:0:24259:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788836645.567336:0:24259:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788836645.567353:0:24259:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1788836645.582925:0:22771:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a80462e7600/0xbd163c7375716248 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836645.582947:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a80462e7600/0xbd163c7375716248 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836645.587579:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a804724df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d9f3bec-9812-4f3e-be22-5440158bfa78:3618:1875730518776064:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788836645.592429:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a80462e7600/0xbd163c7375716248 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836645.592454:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a80462e7600/0xbd163c7375716248 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836645.592514:0:22741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788836645.593057:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8041422c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d9f3bec-9812-4f3e-be22-5440158bfa78+19:3618:x1875730518776192:12345-0@lo:103:ldlm_bl.0 Request processed in 27982us (29022us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836645.593068:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788836645.593195:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a804724f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d9f3bec-9812-4f3e-be22-5440158bfa78:3618:1875730518776192:0@lo:103:ldlm_bl.0 00000001:00000004:2.0:1788836645.596840:0:24259:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:2.0:1788836645.642173:0:24259:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788836645.642182:0:24259:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788836645.642687:0:24259:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788836645.642754:0:24259:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.144@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788836645.642776:0:24259:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788836645.642812:0:24259:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1788836645.649111:0:24259:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788836645.650869:0:24259:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788836646.572210:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788836646.698695:0:24341:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788836646.699401:0:24341:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1788836647.208013:0:22752:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788836647.208025:0:22752:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a80471cd800 from 13 10000000:01000000:1.0:1788836647.208033:0:22752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788836647.208188:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a817f41b600/0xbd163c737571624f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836647.208203:0:22752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.144@tcp lock: ffff9a817f41b600/0xbd163c737571624f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836647.208219:0:22752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.144@tcp lock: ffff9a817f41b600/0xbd163c737571624f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836647.208252:0:22752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d94e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518776320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788836647.208353:0:22752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836647.208442:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8144d659c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836647.208957:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518776320 00000100:00100000:0.0:1788836647.208969:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518776320 00000100:00100000:0.0:1788836647.209123:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788836647.209138:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f414450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+19:22752:x1875730518776320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788836647.209159:0:22750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836647.209180:0:22750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a804738d600/0xbd163c7375716256 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd163c737571624f expref: -99 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836647.209214:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a804738d600/0xbd163c7375716256 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd163c737571624f expref: 20 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836647.209226:0:22750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a804738d600/0xbd163c7375716256 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd163c737571624f expref: 20 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836647.209237:0:22750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a804738d600, rc 0) 00000100:00100000:0.0:1788836647.217446:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f414450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+20:22752:x1875730518776320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 8294us (9075us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836647.217480:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788836647.217662:0:22752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d94e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518776320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788836647.217735:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.144@tcp lock: ffff9a817f41b600/0xbd163c737571624f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375716256 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836647.217752:0:22752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.144@tcp lock: ffff9a817f41b600/0xbd163c737571624f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd163c7375716256 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836647.218399:0:22752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8166d8a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518776448:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788836647.218523:0:22752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836647.219169:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518776448 00000100:00100000:0.0:1788836647.219180:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518776448 00000100:00100000:0.0:1788836647.219238:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788836647.219248:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f416c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+20:22752:x1875730518776448:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788836647.219278:0:22749:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788836647.219306:0:22749:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788836647.219309:0:22749:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1788836647.219429:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f416c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+20:22752:x1875730518776448:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 181us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836647.219437:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788836647.228748:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8160261c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788836647.228813:0:22752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8166d8a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518776448:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788836647.228938:0:22752:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788836647.228953:0:22752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a817f41b600/0xbd163c737571624f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375716256 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836647.228966:0:22752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.144@tcp lock: ffff9a817f41b600/0xbd163c737571624f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375716256 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836647.228980:0:22752:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788836647.228983:0:22752:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a8166ee6000 from 13 10000000:01000000:2.0:1788836647.228986:0:22752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788836647.229033:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a8167974c00/0xbd163c737571625d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836647.229043:0:22752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.144@tcp lock: ffff9a8167974c00/0xbd163c737571625d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836647.229055:0:22752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.144@tcp lock: ffff9a8167974c00/0xbd163c737571625d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836647.229080:0:22752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8166d8a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518776576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788836647.229315:0:22752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836647.229453:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518776576 00000100:00100000:2.0:1788836647.229484:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518776576 00000100:00100000:2.0:1788836647.229684:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788836647.229707:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f417050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+20:22752:x1875730518776576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788836647.229725:0:22750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836647.229741:0:22750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8167974400/0xbd163c7375716264 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd163c737571625d expref: -99 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836647.229784:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8167974400/0xbd163c7375716264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd163c737571625d expref: 21 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836647.229796:0:22750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8167974400/0xbd163c7375716264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd163c737571625d expref: 21 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836647.229806:0:22750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8167974400, rc 0) 00000100:00100000:2.0:1788836647.230667:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f417050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+21:22752:x1875730518776576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 959us (1349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836647.230677:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788836647.230758:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8160261c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788836647.230784:0:22752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8166d8a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518776576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788836647.230806:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.144@tcp lock: ffff9a8167974c00/0xbd163c737571625d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375716264 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836647.230829:0:22752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.144@tcp lock: ffff9a8167974c00/0xbd163c737571625d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd163c7375716264 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836647.230904:0:22752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8166d8a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518776704:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788836647.230946:0:22752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836647.230977:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8160261c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788836647.232347:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518776704 00000100:00100000:0.0:1788836647.232361:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518776704 00000100:00100000:0.0:1788836647.232433:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788836647.232444:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f417c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+21:22752:x1875730518776704:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788836647.232507:0:22748:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788836647.232531:0:22748:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788836647.232535:0:22748:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1788836647.232680:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f417c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+21:22752:x1875730518776704:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 237us (1733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836647.232702:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788836647.233577:0:22752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8166d8a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518776704:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788836647.233682:0:22752:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788836647.233738:0:22752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a8167974c00/0xbd163c737571625d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375716264 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836647.233752:0:22752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.144@tcp lock: ffff9a8167974c00/0xbd163c737571625d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375716264 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836647.589820:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836647.795428:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875730518776832:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788836647.795571:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836647.795639:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788836647.795647:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875730518776960:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788836647.795672:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836647.795758:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518776832 00000100:00100000:2.0:1788836647.795769:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518776832 00000100:00100000:2.0:1788836647.795824:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518776960 00000100:00100000:2.0:1788836647.795828:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518776960 00000100:00100000:2.0:1788836647.795846:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788836647.795856:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166d88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875730518776832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788836647.795906:0:22761:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788836647.795955:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166d88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875730518776832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836647.795964:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788836647.796213:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788836647.796221:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166d89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875730518776960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788836647.796243:0:22761:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788836647.796275:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166d89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875730518776960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 55us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836647.796282:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788836647.796339:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875730518776960:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788836647.796355:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875730518776832:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788836648.614717:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836649.638558:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788836649.702257:0:23516:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788836650.662277:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788836650.856699:0:16590:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788836650.856705:0:16590:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788836650.856708:0:16590:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788836650.856711:0:16590:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788836650.856751:0:16590:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788836650.856755:0:16590:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788836650.856766:0:16590:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788836650.856769:0:16590:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788836650.856821:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875730518777344:0@lo:400:kworker.0 00000100:00100000:0.0:1788836650.856894:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836650.856990:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875730518777856:0@lo:400:kworker.0 00000100:00100000:0.0:1788836650.857016:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836650.857044:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788836650.857050:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875730518777472:0@lo:400:kworker.0 00000100:00100000:0.0:1788836650.857075:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836650.857125:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518777472 00000100:00100000:0.0:1788836650.857132:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518777472 00000100:00100000:2.0:1788836650.857435:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875730518777216:0@lo:400:kworker.0 00000100:00100000:2.0:1788836650.857488:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836650.857515:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875730518777728:0@lo:400:kworker.0 00000100:00100000:2.0:1788836650.857539:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836650.857556:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788836650.857572:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d9f3bec-9812-4f3e-be22-5440158bfa78:3619:1875730518777088:0@lo:400:kworker.0 00000100:00100000:2.0:1788836650.857601:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836650.857622:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875730518777600:0@lo:400:kworker.0 00000100:00100000:2.0:1788836650.857655:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836650.857687:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518777216 00000100:00100000:2.0:1788836650.857691:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518777216 00000100:00100000:3.0:1788836650.857776:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518777344 00000100:00100000:3.0:1788836650.857780:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518777344 00000100:00100000:3.0:1788836650.857826:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518777856 00000100:00100000:3.0:1788836650.857829:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518777856 00000100:00100000:3.0:1788836650.857852:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518777728 00000100:00100000:3.0:1788836650.857855:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518777728 00000100:00100000:3.0:1788836650.857867:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518777600 00000100:00100000:3.0:1788836650.857869:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518777600 00000100:00100000:3.0:1788836650.857884:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788836650.857892:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a816bd76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875730518777344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836650.857950:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a816bd76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875730518777344:12345-0@lo:400:kworker.0 Request processed in 58us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836650.857958:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788836650.857975:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788836650.857981:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a816bd77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875730518777856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836650.858009:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a816bd77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875730518777856:12345-0@lo:400:kworker.0 Request processed in 28us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836650.858015:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788836650.858026:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788836650.858032:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166d89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875730518777728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836650.858060:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166d89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875730518777728:12345-0@lo:400:kworker.0 Request processed in 29us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836650.858065:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788836650.858077:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788836650.858082:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166d8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875730518777600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836650.858104:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166d8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875730518777600:12345-0@lo:400:kworker.0 Request processed in 22us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836650.858108:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1788836650.858144:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a816bd74380 x1875730518777600/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836650.858174:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875730518777600:0@lo:400:kworker.0 00010000:00080000:3.0:1788836650.858191:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a816bd76680 x1875730518777728/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836650.858199:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875730518777728:0@lo:400:kworker.0 00010000:00080000:3.0:1788836650.858233:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a816bd77800 x1875730518777344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836650.858241:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875730518777344:0@lo:400:kworker.0 00010000:00080000:3.0:1788836650.858254:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a816bd75c00 x1875730518777856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836650.858260:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875730518777856:0@lo:400:kworker.0 00000100:00100000:3.0:1788836650.858315:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518777088 00000100:00100000:3.0:1788836650.858320:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518777088 00000100:00100000:3.0:1788836650.858349:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788836650.858356:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f415850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+21:3619:x1875730518777088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836650.858387:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f415850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+21:3619:x1875730518777088:12345-0@lo:400:kworker.0 Request processed in 32us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836650.858394:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788836650.858424:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d9f3bec-9812-4f3e-be22-5440158bfa78:3619:1875730518777088:0@lo:400:kworker.0 00000100:00080000:3.0:1788836650.858459:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788836650.858486:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788836650.858719:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788836650.858728:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8181badc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875730518777472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836650.858766:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8181badc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875730518777472:12345-0@lo:400:kworker.0 Request processed in 40us (1689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836650.858773:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788836650.861232:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875730518777472:0@lo:400:kworker.0 00000100:00100000:2.0:1788836650.870595:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788836650.870619:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166d88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875730518777216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836650.870745:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166d88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875730518777216:12345-0@lo:400:kworker.0 Request processed in 138us (13255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836650.870753:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788836650.871021:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875730518777216:0@lo:400:kworker.0 00010000:00010000:1.0:1788836651.687040:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836651.687070:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788836636/real 1788836636] req@ffff9a817f537800 x1875730518770816/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836651 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836651.687102:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a817f537800 x1875730518770816/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836651 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788836651.687123:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9a8181a72800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788836651.687154:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788836651.687169:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f537800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875730518770816:0@lo:8:kworker.0 00000100:00080000:2.0:1788836651.690484:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788836651.690491:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788836651.690494:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788836651.690497:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788836651.690515:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788836651.690518:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788836651.690522:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a8181a72800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788836651.690530:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 666 00000100:00080000:2.0:1788836651.690536:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788836651.690543:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9a8181a72800 using connection 192.168.201.144@tcp/0@lo 00000100:00100000:2.0:1788836651.690566:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8166d8b100 x1875730518778496/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788836651.690583:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788836651.690593:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788836651.690654:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8166d89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d9f3bec-9812-4f3e-be22-5440158bfa78:3621:1875730518777984:0@lo:400:kworker.0 00000100:00100000:2.0:1788836651.690722:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836651.690759:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8166d8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875730518778624:0@lo:400:kworker.0 00000100:00100000:2.0:1788836651.690786:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836651.690811:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788836651.690816:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8166d88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875730518778368:0@lo:400:kworker.0 00000100:00100000:2.0:1788836651.690840:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836651.690865:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8166d8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875730518778112:0@lo:400:kworker.0 00000100:00100000:2.0:1788836651.690886:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836651.690900:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8166d89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875730518778752:0@lo:400:kworker.0 00000100:00100000:2.0:1788836651.690918:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836651.690935:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788836651.690940:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8166d88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875730518778240:0@lo:400:kworker.0 00000100:00100000:2.0:1788836651.690962:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836651.690978:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8166d8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875730518778880:0@lo:400:kworker.0 00000100:00100000:2.0:1788836651.691002:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836651.691028:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8166d8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875730518778496:0@lo:8:kworker.0 00000100:00100000:2.0:1788836651.691055:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836651.691082:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518777984 00000100:00100000:2.0:1788836651.691089:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518777984 00000100:00100000:2.0:1788836651.691130:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788836651.691275:0:24263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518778496 00000100:00100000:0.0:1788836651.691280:0:24263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518778496 00000100:00100000:2.0:1788836651.691979:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f416450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+21:3621:x1875730518777984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836651.692056:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f416450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+21:3621:x1875730518777984:12345-0@lo:400:kworker.0 Request processed in 917us (1333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836651.692073:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788836651.692113:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518778624 00000100:00100000:2.0:1788836651.692118:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518778624 00000100:00100000:2.0:1788836651.692140:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518778752 00000100:00100000:2.0:1788836651.692143:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518778752 00000100:00100000:0.0:1788836651.692626:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788836651.692633:0:24263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f534700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3617:x1875730518778496:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788836651.692662:0:24263:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 681 last 0 00000020:00000080:0.0:1788836651.692691:0:24263:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xbd163c737571626b 00002000:00100000:0.0:1788836651.692704:0:24263:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9a80475ee800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396b ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1788836651.692708:0:24263:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1788836651.692711:0:24263:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788836651.692887:0:24263:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1788836651.692910:0:24263:0:(import.c:65:import_set_state_nolock()) ffff9a80475ef800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788836651.692962:0:24263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f534700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3617:x1875730518778496:12345-0@lo:8:kworker.0 Request processed in 327us (1905us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836651.692969:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788836651.693104:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8166d89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d9f3bec-9812-4f3e-be22-5440158bfa78:3621:1875730518777984:0@lo:400:kworker.0 00000100:00100000:2.0:1788836651.693253:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518778240 00000100:00100000:2.0:1788836651.693258:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518778240 00000100:00100000:2.0:1788836651.693269:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518778880 00000100:00100000:2.0:1788836651.693272:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518778880 00000100:00100000:2.0:1788836651.694457:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788836651.694486:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166d8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875730518778624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836651.694561:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166d8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875730518778624:12345-0@lo:400:kworker.0 Request processed in 82us (3773us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836651.694568:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788836651.694585:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788836651.694592:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f534a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875730518778752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836651.694661:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f534a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875730518778752:12345-0@lo:400:kworker.0 Request processed in 70us (3741us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836651.694668:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788836651.694680:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788836651.694686:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f537100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875730518778240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836651.694711:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f537100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875730518778240:12345-0@lo:400:kworker.0 Request processed in 25us (3748us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836651.694717:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788836651.694727:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788836651.694734:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f534000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875730518778880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836651.694775:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f534000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875730518778880:12345-0@lo:400:kworker.0 Request processed in 42us (3771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836651.694781:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788836651.694809:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518778368 00000100:00100000:2.0:1788836651.694814:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518778368 00000100:00100000:2.0:1788836651.694842:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518778112 00000100:00100000:2.0:1788836651.694845:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518778112 00000100:00100000:2.0:1788836651.694859:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788836651.694864:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166d8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875730518778368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836651.694893:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166d8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875730518778368:12345-0@lo:400:kworker.0 Request processed in 29us (4053us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836651.694899:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788836651.694909:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788836651.694915:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f537800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875730518778112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836651.694942:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f537800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875730518778112:12345-0@lo:400:kworker.0 Request processed in 27us (4055us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836651.694947:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1788836651.695004:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8166d8b100 x1875730518778496/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788836671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836651.695015:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788836651.695025:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1788836651.695032:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788836651.695038:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788836651.695041:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9a8181a72800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788836651.695054:0:3617:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788836651.695060:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8166d8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875730518778496:0@lo:8:kworker.0 00000004:00080000:2.0:1788836651.695125:0:23500:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00010000:00080000:0.0:1788836651.695264:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8166d88700 x1875730518778240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836651.695275:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8166d88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875730518778240:0@lo:400:kworker.0 00010000:00080000:0.0:1788836651.696246:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8166d8ad80 x1875730518778880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836651.696257:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8166d8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875730518778880:0@lo:400:kworker.0 00000100:00100000:0.0:1788836651.696270:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8166d8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875730518778112:0@lo:400:kworker.0 00010000:00080000:0.0:1788836651.696280:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8166d89c00 x1875730518778752/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836651.696407:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8166d88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875730518778368:0@lo:400:kworker.0 00010000:00080000:1.0:1788836651.696421:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8166d8aa00 x1875730518778624/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836651.696430:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8166d8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875730518778624:0@lo:400:kworker.0 00000100:00100000:1.0:1788836651.696447:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788836651.696455:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f537b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875730518779008:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788836651.696518:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836651.696624:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8166d89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875730518778752:0@lo:400:kworker.0 00000004:00080000:0.0:1788836651.696654:0:23499:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788836651.696735:0:23499:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 681770273286ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788836651.696741:0:23499:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1788836651.696883:0:23500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f536d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23500:1875730518779136:0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1788836651.696912:0:23500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836651.696937:0:23500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a804640d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788836651.696965:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518779008 00000100:00100000:2.0:1788836651.696970:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518779008 00000100:00100000:2.0:1788836651.697014:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788836651.697023:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8172d94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3621:x1875730518779008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788836651.697044:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788836651.697081:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8172d94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3621:x1875730518779008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836651.697087:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788836651.697101:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788836651.697121:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a817f537b80 x1875730518779008/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836667 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836651.697135:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f537b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875730518779008:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788836651.698430:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518779136 00000100:00100000:0.0:1788836651.698438:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518779136 00000100:00100000:0.0:1788836651.698494:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788836651.698503:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8047445880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23500:x1875730518779136:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1788836651.700262:0:23490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:1.0:1788836651.702088:0:24266:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1788836651.702096:0:24266:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:1.0:1788836651.702196:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8047445880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23500:x1875730518779136:12345-0@lo:7:osp-pre-0-1.0 Request processed in 3691us (5279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836651.702210:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788836651.702304:0:23500:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a817f536d80 x1875730518779136/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788836667 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836651.702321:0:23500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f536d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23500:1875730518779136:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1788836651.702335:0:23500:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:2.0:1788836651.702373:0:23500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8047447480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23500:1875730518779264:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1788836651.702408:0:23500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836651.702435:0:23500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a804640d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836651.702596:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518779264 00000100:00100000:0.0:1788836651.702604:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518779264 00000100:00100000:0.0:1788836651.702654:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788836651.702670:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8047447b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23500:x1875730518779264:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788836651.702697:0:24264:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:0.0:1788836651.702740:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8047447b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23500:x1875730518779264:12345-0@lo:5:osp-pre-0-1.0 Request processed in 72us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836651.702746:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788836651.702799:0:23500:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8047447480 x1875730518779264/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788836667 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836651.702816:0:23500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8047447480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23500:1875730518779264:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1788836651.702824:0:23500:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:2.0:1788836651.702846:0:23500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8047447480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23500:1875730518779392:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1788836651.702868:0:23500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836651.702892:0:23500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a804640d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836651.702930:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518779392 00000100:00100000:0.0:1788836651.702934:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518779392 00000100:00100000:0.0:1788836651.702961:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788836651.702968:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8047446300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23500:x1875730518779392:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788836651.702992:0:24266:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000001:00080000:0.0:1788836651.751128:0:24260:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:0.0:1788836651.751267:0:24260:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1788836651.758064:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8047446300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:23500:x1875730518779392:12345-0@lo:5:osp-pre-0-1.0 Request processed in 55087us (55185us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1788836651.758076:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788836651.758077:0:23500:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8047447480 x1875730518779392/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788836667 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836651.758089:0:23500:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1788836651.758095:0:23500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8047447480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23500:1875730518779392:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1788836651.758109:0:23500:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:0.0:1788836651.758167:0:23500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8181badf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23500:1875730518779520:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788836651.758202:0:23500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836651.758233:0:23500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a804634c840 going to sleep for 11 seconds 00000100:00100000:1.0:1788836651.758926:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518779520 00000100:00100000:1.0:1788836651.758934:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518779520 00000100:00100000:1.0:1788836651.758972:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788836651.758981:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8181baca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23500:x1875730518779520:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1788836651.759047:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8181baca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23500:x1875730518779520:12345-0@lo:900:osp-pre-0-1.0 Request processed in 67us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836651.759054:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788836651.759085:0:23500:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8181badf80 x1875730518779520/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788836667 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836651.759103:0:23500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8181badf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23500:1875730518779520:0@lo:900:osp-pre-0-1.0 00010000:00010000:0.0:1788836652.712868:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836652.713225:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788836637/real 1788836637] req@ffff9a804724e300 x1875730518771584/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836652 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836652.713254:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a804724e300 x1875730518771584/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836652 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788836652.713273:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9a80475ef000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788836652.713285:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788836652.713289:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a804724e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875730518771584:0@lo:8:kworker.0 00000100:00080000:0.0:1788836652.713422:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788836652.713426:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788836652.713429:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788836652.713432:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788836652.713491:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788836652.713495:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788836652.713498:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a80475ef000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788836652.713503:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 667 00000100:00080000:0.0:1788836652.713508:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788836652.713514:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a80475ef000 using connection 192.168.201.144@tcp/0@lo 00000100:00100000:0.0:1788836652.713533:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8181bae300 x1875730518780288/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788836652.713575:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8181bafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875730518779776:0@lo:400:kworker.0 00000100:00100000:0.0:1788836652.713650:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836652.713682:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8181baf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875730518780416:0@lo:400:kworker.0 00000100:00100000:0.0:1788836652.713706:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836652.713724:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788836652.713730:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8181baf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875730518779904:0@lo:400:kworker.0 00000100:00100000:0.0:1788836652.713750:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836652.713767:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8181baed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875730518780544:0@lo:400:kworker.0 00000100:00100000:0.0:1788836652.713785:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836652.713816:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518779776 00000100:00100000:0.0:1788836652.713823:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518779776 00000100:00100000:0.0:1788836652.713868:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788836652.713877:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8181bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875730518779776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836652.713957:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8181bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875730518779776:12345-0@lo:400:kworker.0 Request processed in 81us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836652.713964:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788836652.713990:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518780416 00000100:00100000:0.0:1788836652.713999:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518780416 00000100:00100000:0.0:1788836652.714024:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518779904 00000100:00100000:0.0:1788836652.714027:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518779904 00000100:00100000:0.0:1788836652.714038:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518780544 00000100:00100000:0.0:1788836652.714040:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518780544 00000100:00100000:0.0:1788836652.714065:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788836652.714070:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8181bace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875730518780416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836652.714100:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8181bace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875730518780416:12345-0@lo:400:kworker.0 Request processed in 30us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836652.714106:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788836652.714115:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788836652.714120:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8181bad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875730518779904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836652.714145:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8181bad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875730518779904:12345-0@lo:400:kworker.0 Request processed in 24us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836652.714150:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788836652.714160:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788836652.714166:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8181bae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875730518780544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836652.714189:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8181bae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875730518780544:12345-0@lo:400:kworker.0 Request processed in 24us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836652.714195:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1788836652.714230:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788836652.714245:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8181bae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875730518780288:0@lo:8:kworker.0 00000100:00100000:0.0:1788836652.714275:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836652.714313:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518780288 00000100:00100000:0.0:1788836652.714317:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518780288 00000100:00100000:0.0:1788836652.714337:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788836652.714341:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8181bac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3617:x1875730518780288:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788836652.714369:0:24264:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788836652.716812:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8181bac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875730518780032:0@lo:400:kworker.0 00000100:00100000:3.0:1788836652.716885:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836652.716936:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8181bad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875730518780672:0@lo:400:kworker.0 00000100:00100000:3.0:1788836652.716960:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836652.716987:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788836652.716994:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8181bad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d9f3bec-9812-4f3e-be22-5440158bfa78:3620:1875730518779648:0@lo:400:kworker.0 00000100:00100000:3.0:1788836652.717023:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836652.717051:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8181baea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875730518780160:0@lo:400:kworker.0 00000100:00100000:3.0:1788836652.717074:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836652.717107:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518780032 00000100:00100000:3.0:1788836652.717115:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518780032 00000100:00100000:3.0:1788836652.717157:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788836652.717165:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a804724e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875730518780032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836652.717214:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a804724e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875730518780032:12345-0@lo:400:kworker.0 Request processed in 49us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836652.717221:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788836652.717240:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518779648 00000100:00100000:3.0:1788836652.717255:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518779648 00000100:00100000:3.0:1788836652.717282:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788836652.717289:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f416050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+21:3620:x1875730518779648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836652.717318:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f416050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+21:3620:x1875730518779648:12345-0@lo:400:kworker.0 Request processed in 30us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836652.717324:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788836652.717353:0:24266:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788836652.717361:0:24266:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788836652.717487:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8181bad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d9f3bec-9812-4f3e-be22-5440158bfa78:3620:1875730518779648:0@lo:400:kworker.0 00000100:00100000:3.0:1788836652.717501:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8181bac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875730518780032:0@lo:400:kworker.0 00000100:00100000:2.0:1788836652.739243:0:24263:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788836652.739263:0:24263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518780160 00000100:00100000:2.0:1788836652.739272:0:24263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518780160 00000100:00100000:2.0:1788836652.739315:0:24263:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788836652.739326:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788836652.739336:0:24263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a804724c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875730518780160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836652.739449:0:24263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a804724c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875730518780160:12345-0@lo:400:kworker.0 Request processed in 114us (22373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836652.739457:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788836652.739500:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518780672 00000100:00100000:2.0:1788836652.739505:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518780672 00000100:00100000:2.0:1788836652.739544:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788836652.739550:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a804724ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875730518780672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836652.739582:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a804724ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875730518780672:12345-0@lo:400:kworker.0 Request processed in 33us (22622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836652.739588:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1788836652.739645:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8181baf800 x1875730518779904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836652.739660:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8181baf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875730518779904:0@lo:400:kworker.0 00010000:00080000:2.0:1788836652.739692:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8181baed80 x1875730518780544/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836652.739702:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8181baed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875730518780544:0@lo:400:kworker.0 00000100:00100000:2.0:1788836652.739714:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8181bafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875730518779776:0@lo:400:kworker.0 00010000:00080000:2.0:1788836652.739726:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8181baf480 x1875730518780416/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836652.739734:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8181baf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875730518780416:0@lo:400:kworker.0 00010000:00080000:3.0:1788836652.741691:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8181baea00 x1875730518780160/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836652.741706:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8181baea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875730518780160:0@lo:400:kworker.0 00010000:00080000:3.0:1788836652.741718:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8181bad180 x1875730518780672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836652.741725:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8181bad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875730518780672:0@lo:400:kworker.0 00000100:00080000:2.0:1788836652.744158:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788836652.748739:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8181bac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3617:x1875730518780288:12345-0@lo:8:kworker.0 Request processed in 34386us (34453us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788836652.748753:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788836652.748819:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9a80475ef000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788836652.748825:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788836652.748829:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8181bae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875730518780288:0@lo:8:kworker.0 00000100:00100000:2.0:1788836652.903426:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8047446d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875730518780800:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788836652.903512:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836652.903567:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518780800 00000100:00100000:2.0:1788836652.903576:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518780800 00000100:00100000:2.0:1788836652.903630:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788836652.903639:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8047445180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875730518780800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788836652.903671:0:22760:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788836652.903714:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8047445180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875730518780800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836652.903720:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788836652.903760:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8047446d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875730518780800:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788836652.903866:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788836652.903876:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875730518780928:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788836652.903905:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836652.903982:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518780928 00000100:00100000:1.0:1788836652.903986:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518780928 00000100:00100000:1.0:1788836652.904010:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788836652.904016:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8172d96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875730518780928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788836652.904034:0:22761:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788836652.904072:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8172d96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875730518780928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 56us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836652.904078:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788836652.904106:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875730518780928:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788836653.733752:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788836654.041084:0:24632:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg144-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:1.0:1788836654.056093:0:22791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788836654.760997:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788836655.165340:0:24684:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788836655.165722:0:24684:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788836655.784109:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788836656.571078:0:24734:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788836656.571308:0:24734:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788836656.809495:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836656.811545:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788836636/real 1788836636] req@ffff9a817f537480 x1875730518770304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836656 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836656.811576:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a817f537480 x1875730518770304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836656 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836656.811606:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788836636/real 1788836636] req@ffff9a817f536680 x1875730518770432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836656 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836656.811619:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a817f536680 x1875730518770432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788836656 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788836656.811638:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9a815f7e7000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788836656.811657:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788836656.811661:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f537480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875730518770304:0@lo:8:kworker.0 00000100:00080000:2.0:1788836656.811667:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9a8158dbd800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788836656.811672:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788836656.811675:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f536680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875730518770432:0@lo:8:kworker.0 00000100:00080000:3.0:1788836656.812008:0:16590:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788836656.812012:0:16590:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788836656.812015:0:16590:0:(import.c:65:import_set_state_nolock()) ffff9a815f7e7000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788836656.812020:0:16590:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 666 00000100:00080000:3.0:1788836656.812024:0:16590:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788836656.812037:0:16590:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a815f7e7000 using connection 192.168.201.144@tcp/0@lo 00000100:00100000:3.0:1788836656.812057:0:16590:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a804724df80 x1875730518781312/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788836656.812069:0:16590:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788836656.812072:0:16590:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788836656.812074:0:16590:0:(import.c:65:import_set_state_nolock()) ffff9a8158dbd800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788836656.812076:0:16590:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 666 00000100:00080000:3.0:1788836656.812079:0:16590:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788836656.812082:0:16590:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a8158dbd800 using connection 192.168.201.144@tcp/0@lo 00000100:00100000:3.0:1788836656.812104:0:16590:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a804724c380 x1875730518781440/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788836656.812132:0:16590:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788836656.812136:0:16590:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788836656.812137:0:16590:0:(import.c:65:import_set_state_nolock()) ffff9a80475ef000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788836656.812141:0:16590:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 682 00000100:00080000:3.0:1788836656.812143:0:16590:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788836656.812147:0:16590:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a80475ef000 using connection 192.168.201.144@tcp/0@lo 00000100:00100000:3.0:1788836656.812158:0:16590:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a804724e680 x1875730518781952/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788836656.812197:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a804724f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875730518781184:0@lo:400:kworker.0 00000100:00100000:3.0:1788836656.812254:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836656.812298:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a804724ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875730518782080:0@lo:400:kworker.0 00000100:00100000:3.0:1788836656.812317:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836656.812336:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788836656.812347:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a804724d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875730518781568:0@lo:400:kworker.0 00000100:00100000:3.0:1788836656.812366:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836656.812380:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a804724f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875730518782208:0@lo:400:kworker.0 00000100:00100000:3.0:1788836656.812399:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836656.812441:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518781184 00000100:00100000:3.0:1788836656.812449:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518781184 00000100:00100000:3.0:1788836656.812515:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788836656.812535:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a816bd75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875730518781184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836656.812589:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a816bd75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875730518781184:12345-0@lo:400:kworker.0 Request processed in 65us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836656.812596:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788836656.812618:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518782080 00000100:00100000:3.0:1788836656.812622:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518782080 00000100:00100000:3.0:1788836656.812645:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518781568 00000100:00100000:3.0:1788836656.812648:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518781568 00000100:00100000:3.0:1788836656.812658:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518782208 00000100:00100000:3.0:1788836656.812660:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518782208 00000100:00100000:3.0:1788836656.812683:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788836656.812689:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a816bd75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875730518782080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836656.812719:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a816bd75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875730518782080:12345-0@lo:400:kworker.0 Request processed in 31us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836656.812725:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788836656.812736:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788836656.812742:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a816bd75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875730518781568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836656.812773:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a816bd75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875730518781568:12345-0@lo:400:kworker.0 Request processed in 31us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836656.812778:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788836656.812796:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788836656.812802:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a816bd77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875730518782208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836656.812829:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a816bd77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875730518782208:12345-0@lo:400:kworker.0 Request processed in 27us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836656.812835:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1788836656.812862:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788836656.812887:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a804724d500 x1875730518781568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836656.812899:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a804724d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875730518781568:0@lo:400:kworker.0 00010000:00080000:3.0:1788836656.812908:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a804724f800 x1875730518782208/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836656.812915:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a804724f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875730518782208:0@lo:400:kworker.0 00000100:00100000:3.0:1788836656.812923:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a804724f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875730518781184:0@lo:400:kworker.0 00010000:00080000:3.0:1788836656.812930:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a804724ce00 x1875730518782080/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836656.812937:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a804724ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875730518782080:0@lo:400:kworker.0 00000100:00100000:2.0:1788836656.813972:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a804724ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d9f3bec-9812-4f3e-be22-5440158bfa78:3619:1875730518781056:0@lo:400:kworker.0 00000100:00100000:2.0:1788836656.814027:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836656.814073:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a804724dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875730518781824:0@lo:400:kworker.0 00000100:00100000:2.0:1788836656.814109:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836656.814135:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788836656.814140:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a804724d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875730518781696:0@lo:400:kworker.0 00000100:00100000:2.0:1788836656.814161:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836656.814180:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875730518782336:0@lo:400:kworker.0 00000100:00100000:2.0:1788836656.814200:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836656.814229:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518782336 00000100:00100000:2.0:1788836656.814233:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518782336 00000100:00100000:2.0:1788836656.814272:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788836656.814279:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8047445c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875730518782336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836656.814326:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8047445c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875730518782336:12345-0@lo:400:kworker.0 Request processed in 47us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836656.814333:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788836656.814350:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518781696 00000100:00100000:2.0:1788836656.814353:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518781696 00000100:00100000:2.0:1788836656.814372:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788836656.814378:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8047446680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875730518781696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836656.814415:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8047446680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875730518781696:12345-0@lo:400:kworker.0 Request processed in 37us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836656.814420:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1788836656.814436:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788836656.814482:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a804724d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875730518781696:0@lo:400:kworker.0 00010000:00080000:2.0:1788836656.814494:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a816bd75f80 x1875730518782336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836656.814504:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875730518782336:0@lo:400:kworker.0 00000100:00100000:2.0:1788836656.814534:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a804724df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875730518781312:0@lo:8:kworker.0 00000100:00100000:2.0:1788836656.814562:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836656.814584:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a804724c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875730518781440:0@lo:8:kworker.0 00000100:00100000:2.0:1788836656.814605:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836656.814618:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a804724e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875730518781952:0@lo:8:kworker.0 00000100:00100000:2.0:1788836656.814637:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836656.814659:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518781824 00000100:00100000:2.0:1788836656.814662:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518781824 00000100:00100000:2.0:1788836656.814681:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518781312 00000100:00100000:2.0:1788836656.814684:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518781312 00000100:00100000:2.0:1788836656.814697:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518781440 00000100:00100000:2.0:1788836656.814699:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518781440 00000100:00100000:2.0:1788836656.814705:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518781952 00000100:00100000:2.0:1788836656.814707:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518781952 00000100:00100000:2.0:1788836656.814716:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788836656.814721:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8047446d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875730518781824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836656.814752:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8047446d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875730518781824:12345-0@lo:400:kworker.0 Request processed in 31us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836656.814758:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788836656.814768:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788836656.814772:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8047444a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3617:x1875730518781312:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788836656.814795:0:24266:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 686 last 0 00000020:00000080:2.0:1788836656.814818:0:24266:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbd163c7375716272 00002000:00100000:2.0:1788836656.814830:0:24266:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9a804743d000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396b ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788836656.814834:0:24266:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788836656.814836:0:24266:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1788836656.815115:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788836656.815122:0:24263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8047447800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3617:x1875730518781440:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788836656.815134:0:24263:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788836656.815183:0:24263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8047447800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3617:x1875730518781440:12345-0@lo:8:kworker.0 Request processed in 61us (577us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788836656.815190:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788836656.815202:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788836656.815206:0:24263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8047444000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3617:x1875730518781952:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788836656.815215:0:24263:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788836656.815249:0:24263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8047444000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3617:x1875730518781952:12345-0@lo:8:kworker.0 Request processed in 41us (611us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788836656.815254:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1788836656.815278:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9a8158dbd800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788836656.815283:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788836656.815287:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a804724c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875730518781440:0@lo:8:kworker.0 00000100:00080000:1.0:1788836656.815294:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9a80475ef000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788836656.815297:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788836656.815300:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a804724e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875730518781952:0@lo:8:kworker.0 00002000:00080000:2.0:1788836656.816328:0:24266:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788836656.816351:0:24266:0:(import.c:65:import_set_state_nolock()) ffff9a804743d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788836656.816656:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518781056 00000100:00100000:3.0:1788836656.816664:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518781056 00000100:00100000:3.0:1788836656.816715:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788836656.816723:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f416850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+21:3619:x1875730518781056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836656.816763:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f416850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+21:3619:x1875730518781056:12345-0@lo:400:kworker.0 Request processed in 41us (2735us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836656.816769:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:0.0:1788836656.816891:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a804724df80 x1875730518781312/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788836681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836656.816903:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788836656.816910:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788836656.816916:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788836656.816921:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788836656.816923:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9a815f7e7000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788836656.816936:0:3617:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788836656.816941:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a804724df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875730518781312:0@lo:8:kworker.0 00000100:00100000:2.0:1788836656.817503:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8047444a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3617:x1875730518781312:12345-0@lo:8:kworker.0 Request processed in 2727us (2937us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836656.817512:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000004:00080000:2.0:1788836656.817779:0:22780:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x22:0x0] 00000100:00100000:2.0:1788836656.817798:0:22780:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8047447100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22780:1875730518782592:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788836656.817837:0:22780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836656.817859:0:22780:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a81589083c0 going to sleep for 11 seconds 00000004:00080000:2.0:1788836656.817929:0:22779:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788836656.818026:0:22779:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 686891563531ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788836656.818043:0:22779:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00080000:2.0:1788836656.818301:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788836656.818316:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8047446a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875730518782464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788836656.818343:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836656.818374:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a804724ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d9f3bec-9812-4f3e-be22-5440158bfa78:3619:1875730518781056:0@lo:400:kworker.0 00010000:00080000:2.0:1788836656.818388:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a804724dc00 x1875730518781824/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788836672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836656.818398:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a804724dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875730518781824:0@lo:400:kworker.0 00000100:00100000:2.0:1788836656.818436:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518782464 00000100:00100000:2.0:1788836656.818441:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518782464 00000100:00100000:2.0:1788836656.818702:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788836656.818711:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8047444380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1875730518782464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788836656.818751:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788836656.818789:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8047444380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1875730518782464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836656.818795:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788836656.818813:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788836656.818828:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8047446a00 x1875730518782464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836672 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836656.818844:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8047446a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875730518782464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788836656.823499:0:24263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518782592 00000100:00100000:0.0:1788836656.823515:0:24263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518782592 00000100:00100000:0.0:1788836656.823595:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788836656.823605:0:24263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8047445f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22780:x1875730518782592:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788836656.829458:0:24263:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1788836656.829503:0:24263:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:0.0:1788836656.829509:0:24263:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:35 to 0x280000401:65) 00002000:00010000:2.0:1788836656.841686:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788836656.841704:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c486adef/0xbd163c7375716279 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.841726:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=686s v=(0 0) 00010000:00010000:2.0:1788836656.841743:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836656.841751:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c486adef/0xbd163c7375716279 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.841774:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c486adef/0xbd163c7375716279 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.841785:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c486adef/0xbd163c7375716279 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.841792:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c486adef/0xbd163c7375716279 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.841814:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1788836656.842028:0:22735:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:0.0:1788836656.842350:0:22743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836656.842363:0:22743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c486adef/0xbd163c7375716279 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.842378:0:22743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8167975400 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:0.0:1788836656.842385:0:22743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c486adef/0xbd163c7375716279 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.842398:0:22743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c486adef/0xbd163c7375716279 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.842429:0:22743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c486adef/0xbd163c7375716279 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.842437:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c486adef/0xbd163c7375716279 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.842490:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836656.842493:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836656.842495:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788836656.842684:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788836656.842693:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9541435/0xbd163c7375716280 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.842705:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=686s v=(0 0) 00010000:00010000:2.0:1788836656.842709:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836656.842713:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9541435/0xbd163c7375716280 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.842724:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9541435/0xbd163c7375716280 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.842734:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9541435/0xbd163c7375716280 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.842750:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9541435/0xbd163c7375716280 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.842818:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788836656.844309:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788836656.844320:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006095878b/0xbd163c7375716287 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.844332:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=686s v=(0 0) 00010000:00010000:2.0:1788836656.844336:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836656.844341:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006095878b/0xbd163c7375716287 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.844354:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006095878b/0xbd163c7375716287 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.844364:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006095878b/0xbd163c7375716287 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.844372:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006095878b/0xbd163c7375716287 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.849355:0:23912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788836656.849378:0:23912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9541435/0xbd163c7375716280 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.849395:0:23912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8167974800 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:1.0:1788836656.849401:0:23912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9541435/0xbd163c7375716280 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.849414:0:23912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9541435/0xbd163c7375716280 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.849445:0:23912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9541435/0xbd163c7375716280 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.849453:0:23912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9541435/0xbd163c7375716280 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.849544:0:23912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836656.849549:0:23912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006095878b/0xbd163c7375716287 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.849557:0:23912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8167974a00 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:1.0:1788836656.849561:0:23912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006095878b/0xbd163c7375716287 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.849569:0:23912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006095878b/0xbd163c7375716287 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.849584:0:23912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006095878b/0xbd163c7375716287 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.849593:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836656.849595:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836656.849598:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836656.850038:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788836656.850047:0:24263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006095878b/0xbd163c7375716287 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.850263:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788836656.854604:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788836656.854619:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000117d4710/0xbd163c737571628e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.854636:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=686s v=(0 0) 00010000:00010000:2.0:1788836656.854641:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836656.854648:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000117d4710/0xbd163c737571628e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.854663:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000117d4710/0xbd163c737571628e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.854673:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000117d4710/0xbd163c737571628e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.854681:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000117d4710/0xbd163c737571628e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.854706:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788836656.854745:0:22743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836656.854762:0:22743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000117d4710/0xbd163c737571628e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.854775:0:22743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8167975600 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:0.0:1788836656.854781:0:22743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000117d4710/0xbd163c737571628e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.854815:0:22743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000117d4710/0xbd163c737571628e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.854843:0:22743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000117d4710/0xbd163c737571628e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.854853:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000117d4710/0xbd163c737571628e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.854878:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836656.854880:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836656.854883:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788836656.855516:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788836656.855535:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046cc1416/0xbd163c7375716295 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.855547:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=686s v=(0 0) 00010000:00010000:2.0:1788836656.855552:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836656.855564:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046cc1416/0xbd163c7375716295 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.855575:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046cc1416/0xbd163c7375716295 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.855584:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046cc1416/0xbd163c7375716295 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.855591:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046cc1416/0xbd163c7375716295 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.855608:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788836656.856245:0:23912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836656.856254:0:23912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046cc1416/0xbd163c7375716295 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.856265:0:23912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8167975200 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:1.0:1788836656.856270:0:23912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046cc1416/0xbd163c7375716295 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.856292:0:23912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046cc1416/0xbd163c7375716295 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.856309:0:23912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046cc1416/0xbd163c7375716295 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.856315:0:23912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046cc1416/0xbd163c7375716295 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.856335:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836656.856336:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836656.856338:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788836656.856437:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788836656.856444:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b736133/0xbd163c737571629c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.856453:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=686s v=(0 0) 00010000:00010000:2.0:1788836656.856456:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836656.856485:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b736133/0xbd163c737571629c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.856499:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b736133/0xbd163c737571629c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.856508:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b736133/0xbd163c737571629c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.856538:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b736133/0xbd163c737571629c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.856554:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788836656.856785:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836656.856791:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b736133/0xbd163c737571629c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.856799:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8167974000 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:1.0:1788836656.856803:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b736133/0xbd163c737571629c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.856811:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b736133/0xbd163c737571629c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.856821:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b736133/0xbd163c737571629c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.856838:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b736133/0xbd163c737571629c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.856854:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836656.856857:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836656.856859:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788836656.856952:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788836656.856958:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084cb1465/0xbd163c73757162a3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.857272:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=686s v=(0 0) 00010000:00010000:2.0:1788836656.857276:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836656.857280:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084cb1465/0xbd163c73757162a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.857290:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084cb1465/0xbd163c73757162a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.857297:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084cb1465/0xbd163c73757162a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.857304:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084cb1465/0xbd163c73757162a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.857323:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788836656.857373:0:22743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836656.857388:0:22743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084cb1465/0xbd163c73757162a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.857401:0:22743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8167974e00 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:0.0:1788836656.857407:0:22743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084cb1465/0xbd163c73757162a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.857418:0:22743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084cb1465/0xbd163c73757162a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.857451:0:22743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084cb1465/0xbd163c73757162a3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.857852:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084cb1465/0xbd163c73757162a3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788836656.858368:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788836656.858377:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006095878b/0xbd163c73757162aa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.858394:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=686s v=(0 0) 00010000:00010000:2.0:1788836656.858398:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836656.858403:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006095878b/0xbd163c73757162aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.858414:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006095878b/0xbd163c73757162aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.858423:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006095878b/0xbd163c73757162aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.858430:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006095878b/0xbd163c73757162aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.858454:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788836656.858567:0:23912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836656.858577:0:23912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006095878b/0xbd163c73757162aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.858590:0:23912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8167974a00 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:0.0:1788836656.858595:0:23912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006095878b/0xbd163c73757162aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.858607:0:23912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006095878b/0xbd163c73757162aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.858686:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836656.858689:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836656.858691:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836656.858807:0:23912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006095878b/0xbd163c73757162aa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.858816:0:23912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006095878b/0xbd163c73757162aa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.858837:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836656.858839:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836656.858842:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788836656.859793:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788836656.859803:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9541435/0xbd163c73757162b1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.859816:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=686s v=(0 0) 00010000:00010000:2.0:1788836656.859819:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836656.859824:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9541435/0xbd163c73757162b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.859835:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9541435/0xbd163c73757162b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.859857:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9541435/0xbd163c73757162b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.859864:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9541435/0xbd163c73757162b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.859885:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788836656.860048:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836656.860062:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9541435/0xbd163c73757162b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.860071:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8167974800 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:1.0:1788836656.860075:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9541435/0xbd163c73757162b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.860084:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9541435/0xbd163c73757162b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.860157:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9541435/0xbd163c73757162b1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.860166:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9541435/0xbd163c73757162b1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.860196:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836656.860198:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836656.860200:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788836656.861208:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788836656.861217:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c486adef/0xbd163c73757162b8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.861228:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=686s v=(0 0) 00010000:00010000:2.0:1788836656.861231:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836656.861235:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c486adef/0xbd163c73757162b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.861245:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c486adef/0xbd163c73757162b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.861254:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c486adef/0xbd163c73757162b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.861261:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c486adef/0xbd163c73757162b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.861299:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788836656.861355:0:22743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836656.861369:0:22743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c486adef/0xbd163c73757162b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836656.861384:0:22743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8167975400 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:3.0:1788836656.861390:0:22743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c486adef/0xbd163c73757162b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836656.861403:0:22743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c486adef/0xbd163c73757162b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836656.861434:0:22743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c486adef/0xbd163c73757162b8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836656.861443:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c486adef/0xbd163c73757162b8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836656.861519:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836656.861522:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836656.861534:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788836656.863971:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788836656.863985:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046cc1416/0xbd163c73757162bf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.864001:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=686s v=(0 0) 00010000:00010000:2.0:1788836656.864005:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836656.864011:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046cc1416/0xbd163c73757162bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.864025:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046cc1416/0xbd163c73757162bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.864035:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046cc1416/0xbd163c73757162bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.864041:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046cc1416/0xbd163c73757162bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.864069:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788836656.864103:0:23912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836656.864118:0:23912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046cc1416/0xbd163c73757162bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.864154:0:23912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8167975200 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:0.0:1788836656.864161:0:23912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046cc1416/0xbd163c73757162bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.864174:0:23912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046cc1416/0xbd163c73757162bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.864200:0:23912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046cc1416/0xbd163c73757162bf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.864210:0:23912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046cc1416/0xbd163c73757162bf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.864249:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836656.864252:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836656.864254:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788836656.864559:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788836656.864566:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000117d4710/0xbd163c73757162c6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.864574:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=686s v=(0 0) 00010000:00010000:2.0:1788836656.864583:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836656.864587:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000117d4710/0xbd163c73757162c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.864595:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000117d4710/0xbd163c73757162c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.864603:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000117d4710/0xbd163c73757162c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.864610:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000117d4710/0xbd163c73757162c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.864626:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788836656.864775:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836656.864783:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000117d4710/0xbd163c73757162c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.864792:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8167975600 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:1.0:1788836656.864797:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000117d4710/0xbd163c73757162c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.864806:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000117d4710/0xbd163c73757162c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.864823:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000117d4710/0xbd163c73757162c6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.864830:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000117d4710/0xbd163c73757162c6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.864848:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836656.864850:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836656.864852:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788836656.864949:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788836656.864955:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d02df92/0xbd163c73757162cd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.864971:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=686s v=(0 0) 00010000:00010000:2.0:1788836656.864974:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836656.864978:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d02df92/0xbd163c73757162cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.864988:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d02df92/0xbd163c73757162cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.864995:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d02df92/0xbd163c73757162cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.865010:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d02df92/0xbd163c73757162cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.865029:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788836656.865101:0:22743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836656.865112:0:22743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d02df92/0xbd163c73757162cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836656.865124:0:22743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8140030000 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:3.0:1788836656.865273:0:22743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d02df92/0xbd163c73757162cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836656.865304:0:22743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d02df92/0xbd163c73757162cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836656.865322:0:22743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d02df92/0xbd163c73757162cd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836656.865331:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d02df92/0xbd163c73757162cd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836656.865356:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836656.865358:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836656.865360:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788836656.865723:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788836656.865730:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbb37f6e/0xbd163c73757162d4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.865740:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=686s v=(0 0) 00010000:00010000:2.0:1788836656.865743:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836656.865748:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dbb37f6e/0xbd163c73757162d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.865758:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dbb37f6e/0xbd163c73757162d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.865766:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbb37f6e/0xbd163c73757162d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.865773:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dbb37f6e/0xbd163c73757162d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.865791:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788836656.865829:0:23912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836656.865840:0:23912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dbb37f6e/0xbd163c73757162d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.865851:0:23912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8140030c00 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:0.0:1788836656.865856:0:23912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbb37f6e/0xbd163c73757162d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.865866:0:23912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbb37f6e/0xbd163c73757162d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.866183:0:23912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dbb37f6e/0xbd163c73757162d4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.866192:0:23912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dbb37f6e/0xbd163c73757162d4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.866218:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788836656.866221:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788836656.866222:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836656.866226:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836656.866233:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067b37f71/0xbd163c73757162db lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.866250:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=686s v=(0 0) 00010000:00010000:2.0:1788836656.866253:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836656.866257:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067b37f71/0xbd163c73757162db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.866266:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067b37f71/0xbd163c73757162db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.866274:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067b37f71/0xbd163c73757162db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.866280:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067b37f71/0xbd163c73757162db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.866299:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788836656.866440:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836656.866446:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067b37f71/0xbd163c73757162db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.866507:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8140030e00 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:1.0:1788836656.866512:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067b37f71/0xbd163c73757162db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.866521:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067b37f71/0xbd163c73757162db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.866547:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067b37f71/0xbd163c73757162db lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.866554:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067b37f71/0xbd163c73757162db lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.866577:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836656.866581:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836656.866587:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788836656.866701:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788836656.866707:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab8ea867/0xbd163c73757162e2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.866716:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=686s v=(0 0) 00010000:00010000:2.0:1788836656.866719:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836656.866723:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab8ea867/0xbd163c73757162e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.866733:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab8ea867/0xbd163c73757162e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.866752:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab8ea867/0xbd163c73757162e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.866759:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab8ea867/0xbd163c73757162e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.866777:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788836656.866812:0:22743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836656.866822:0:22743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab8ea867/0xbd163c73757162e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836656.866834:0:22743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8140031a00 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:3.0:1788836656.866838:0:22743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab8ea867/0xbd163c73757162e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836656.866849:0:22743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab8ea867/0xbd163c73757162e2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836656.866874:0:22743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab8ea867/0xbd163c73757162e2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836656.866902:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab8ea867/0xbd163c73757162e2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836656.866925:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836656.866927:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836656.866929:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788836656.867344:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788836656.867352:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b055f43/0xbd163c73757162e9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.867362:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=686s v=(0 0) 00010000:00010000:2.0:1788836656.867365:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836656.867369:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b055f43/0xbd163c73757162e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.867380:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b055f43/0xbd163c73757162e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.867388:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b055f43/0xbd163c73757162e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.867395:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b055f43/0xbd163c73757162e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.867426:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788836656.867510:0:23912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836656.867521:0:23912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b055f43/0xbd163c73757162e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.867542:0:23912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8140031600 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:0.0:1788836656.867546:0:23912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b055f43/0xbd163c73757162e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.867556:0:23912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b055f43/0xbd163c73757162e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.867572:0:23912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b055f43/0xbd163c73757162e9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.867732:0:23912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b055f43/0xbd163c73757162e9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.867771:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836656.867773:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836656.867775:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788836656.868624:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788836656.868633:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e580176/0xbd163c73757162f0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.868646:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=686s v=(0 0) 00010000:00010000:2.0:1788836656.868650:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836656.868654:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e580176/0xbd163c73757162f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.868665:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e580176/0xbd163c73757162f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.868674:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e580176/0xbd163c73757162f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.868681:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e580176/0xbd163c73757162f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.868704:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788836656.868739:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836656.868750:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e580176/0xbd163c73757162f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836656.868763:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8140030400 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:3.0:1788836656.868768:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e580176/0xbd163c73757162f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836656.868780:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e580176/0xbd163c73757162f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836656.868801:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e580176/0xbd163c73757162f0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836656.868809:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e580176/0xbd163c73757162f0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788836656.875389:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788836656.875409:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1a0c390/0xbd163c73757162f7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.875429:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1788836656.875442:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836656.875448:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836656.875454:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836656.875456:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836656.875495:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1a0c390/0xbd163c73757162f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.875513:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1a0c390/0xbd163c73757162f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.875534:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1a0c390/0xbd163c73757162f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.875544:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1a0c390/0xbd163c73757162f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.875568:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788836656.877396:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788836656.877408:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f73ea27/0xbd163c73757162fe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.877424:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=686s v=(0 0) 00010000:00010000:2.0:1788836656.877428:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836656.877434:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f73ea27/0xbd163c73757162fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.877449:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f73ea27/0xbd163c73757162fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836656.877668:0:22743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836656.877683:0:22743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1a0c390/0xbd163c73757162f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836656.877697:0:22743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8140031e00 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:3.0:1788836656.877713:0:22743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1a0c390/0xbd163c73757162f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836656.877726:0:22743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1a0c390/0xbd163c73757162f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836656.877753:0:22743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1a0c390/0xbd163c73757162f7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836656.877762:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1a0c390/0xbd163c73757162f7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836656.877791:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836656.877793:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836656.877795:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836656.877954:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f73ea27/0xbd163c73757162fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.878305:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f73ea27/0xbd163c73757162fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.878376:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788836656.882840:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788836656.882860:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048fd26d6/0xbd163c7375716305 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.882882:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=686s v=(0 0) 00010000:00010000:0.0:1788836656.882888:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836656.882896:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048fd26d6/0xbd163c7375716305 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.882913:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048fd26d6/0xbd163c7375716305 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.882926:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048fd26d6/0xbd163c7375716305 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.882935:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048fd26d6/0xbd163c7375716305 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.882974:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788836656.883223:0:23912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788836656.883636:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836656.883645:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048fd26d6/0xbd163c7375716305 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.883668:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a804738c400 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:0.0:1788836656.883673:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048fd26d6/0xbd163c7375716305 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.883684:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048fd26d6/0xbd163c7375716305 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.883717:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048fd26d6/0xbd163c7375716305 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.883725:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048fd26d6/0xbd163c7375716305 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.883749:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836656.883751:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836656.883753:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788836656.883811:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788836656.883818:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4d2ceb2/0xbd163c737571630c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.883828:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=686s v=(0 0) 00010000:00010000:0.0:1788836656.883832:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836656.883837:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4d2ceb2/0xbd163c737571630c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.883848:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4d2ceb2/0xbd163c737571630c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.883864:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4d2ceb2/0xbd163c737571630c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.883873:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4d2ceb2/0xbd163c737571630c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.883891:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788836656.884239:0:22743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836656.884246:0:22743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4d2ceb2/0xbd163c737571630c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836656.884255:0:22743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a804738d000 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:3.0:1788836656.884258:0:22743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4d2ceb2/0xbd163c737571630c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836656.884279:0:22743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4d2ceb2/0xbd163c737571630c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836656.884292:0:22743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4d2ceb2/0xbd163c737571630c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836656.884299:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4d2ceb2/0xbd163c737571630c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836656.884316:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836656.884318:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836656.884319:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836656.884603:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788836656.884610:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000177b5dd7/0xbd163c7375716313 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836656.884621:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1788836656.884625:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836656.884631:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000177b5dd7/0xbd163c7375716313 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.884645:0:23912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f73ea27/0xbd163c73757162fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836656.884647:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000177b5dd7/0xbd163c7375716313 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836656.884684:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000177b5dd7/0xbd163c7375716313 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.884688:0:23912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a817ed14800 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:1.0:1788836656.884694:0:23912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f73ea27/0xbd163c73757162fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.884709:0:23912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f73ea27/0xbd163c73757162fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.884746:0:23912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f73ea27/0xbd163c73757162fe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.884755:0:23912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f73ea27/0xbd163c73757162fe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836656.884785:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000177b5dd7/0xbd163c7375716313 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.884796:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836656.884800:0:23912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836656.884805:0:23912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000177b5dd7/0xbd163c7375716313 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836656.884811:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788836656.884843:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836656.885237:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788836656.885244:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d1bc489/0xbd163c737571631a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836656.885255:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1788836656.885258:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836656.885263:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d1bc489/0xbd163c737571631a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836656.885274:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d1bc489/0xbd163c737571631a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836656.885283:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d1bc489/0xbd163c737571631a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836656.885290:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d1bc489/0xbd163c737571631a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.885318:0:23912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a80462e6200 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:3.0:1788836656.885325:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788836656.885356:0:22743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836656.885366:0:22743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d1bc489/0xbd163c737571631a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.885376:0:22743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a80462e7600 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:0.0:1788836656.885380:0:22743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d1bc489/0xbd163c737571631a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.885389:0:22743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d1bc489/0xbd163c737571631a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.885402:0:22743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d1bc489/0xbd163c737571631a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.885409:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d1bc489/0xbd163c737571631a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.885442:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836656.885444:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836656.885446:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788836656.885905:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788836656.885913:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a7327be/0xbd163c7375716321 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836656.885930:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1788836656.885934:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836656.885939:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a7327be/0xbd163c7375716321 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836656.885951:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a7327be/0xbd163c7375716321 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836656.885960:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a7327be/0xbd163c7375716321 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836656.885968:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a7327be/0xbd163c7375716321 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836656.885989:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788836656.886106:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836656.886114:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a7327be/0xbd163c7375716321 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.886123:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a80462e6c00 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:0.0:1788836656.886127:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a7327be/0xbd163c7375716321 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.886136:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a7327be/0xbd163c7375716321 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.886150:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a7327be/0xbd163c7375716321 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.886157:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a7327be/0xbd163c7375716321 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.886177:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836656.886179:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836656.886181:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836656.886278:0:23912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000177b5dd7/0xbd163c7375716313 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.886289:0:23912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000177b5dd7/0xbd163c7375716313 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.886300:0:23912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000177b5dd7/0xbd163c7375716313 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.886307:0:23912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000177b5dd7/0xbd163c7375716313 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.886337:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836656.886347:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836656.886350:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788836656.886581:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788836656.886588:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000591bbec4/0xbd163c7375716328 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.886611:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=686s v=(0 0) 00010000:00010000:0.0:1788836656.886617:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836656.886624:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000591bbec4/0xbd163c7375716328 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.886637:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000591bbec4/0xbd163c7375716328 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.886646:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000591bbec4/0xbd163c7375716328 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.886653:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000591bbec4/0xbd163c7375716328 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.886679:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788836656.886989:0:22743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836656.886995:0:22743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000591bbec4/0xbd163c7375716328 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.887003:0:22743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a804738d400 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:1.0:1788836656.887007:0:22743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000591bbec4/0xbd163c7375716328 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.887016:0:22743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000591bbec4/0xbd163c7375716328 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.887031:0:22743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000591bbec4/0xbd163c7375716328 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.887039:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000591bbec4/0xbd163c7375716328 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.887314:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836656.887317:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836656.887320:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788836656.887678:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788836656.887686:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a63598f/0xbd163c737571632f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.887697:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=686s v=(0 0) 00010000:00010000:0.0:1788836656.887701:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836656.887705:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a63598f/0xbd163c737571632f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.887715:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a63598f/0xbd163c737571632f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.887736:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a63598f/0xbd163c737571632f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.887742:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a63598f/0xbd163c737571632f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.887770:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788836656.889358:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788836656.889576:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836656.889585:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a63598f/0xbd163c737571632f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.889597:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a804738cc00 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:1.0:1788836656.889603:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a63598f/0xbd163c737571632f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.889623:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a63598f/0xbd163c737571632f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.889642:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a63598f/0xbd163c737571632f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.889649:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a63598f/0xbd163c737571632f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.889672:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836656.889674:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836656.889677:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836656.889801:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4d2ceb2/0xbd163c7375716336 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.889812:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=686s v=(0 0) 00010000:00010000:0.0:1788836656.889816:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836656.889822:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4d2ceb2/0xbd163c7375716336 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.889836:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4d2ceb2/0xbd163c7375716336 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.889846:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4d2ceb2/0xbd163c7375716336 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.889853:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4d2ceb2/0xbd163c7375716336 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.889887:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788836656.890242:0:23912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836656.890248:0:23912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4d2ceb2/0xbd163c7375716336 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.890256:0:23912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a804738d000 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:1.0:1788836656.890259:0:23912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4d2ceb2/0xbd163c7375716336 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.890268:0:23912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4d2ceb2/0xbd163c7375716336 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.890279:0:23912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4d2ceb2/0xbd163c7375716336 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.890297:0:23912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4d2ceb2/0xbd163c7375716336 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.890313:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836656.890315:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836656.890317:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788836656.890415:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788836656.890421:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048fd26d6/0xbd163c737571633d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.890430:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=686s v=(0 0) 00010000:00010000:0.0:1788836656.890434:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836656.890438:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048fd26d6/0xbd163c737571633d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.890448:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048fd26d6/0xbd163c737571633d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.890457:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048fd26d6/0xbd163c737571633d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.890815:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048fd26d6/0xbd163c737571633d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.890835:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788836656.891303:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788836656.891310:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b055f43/0xbd163c7375716344 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.891320:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=686s v=(0 0) 00010000:00010000:0.0:1788836656.891330:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836656.891335:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b055f43/0xbd163c7375716344 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.891346:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b055f43/0xbd163c7375716344 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.891356:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b055f43/0xbd163c7375716344 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.891363:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b055f43/0xbd163c7375716344 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.891386:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788836656.891439:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788836656.891453:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048fd26d6/0xbd163c737571633d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.891490:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a804738c400 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:2.0:1788836656.891497:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048fd26d6/0xbd163c737571633d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.891510:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048fd26d6/0xbd163c737571633d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.891799:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048fd26d6/0xbd163c737571633d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.891808:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048fd26d6/0xbd163c737571633d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.891838:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836656.891843:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b055f43/0xbd163c7375716344 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.891865:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8140031600 already unused, calling callback (ffffffffc0db0350) 00002000:00010000:0.0:1788836656.892137:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788836656.892145:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1a0c390/0xbd163c737571634b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.892155:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=686s v=(0 0) 00010000:00010000:0.0:1788836656.892158:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836656.892162:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1a0c390/0xbd163c737571634b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.892172:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1a0c390/0xbd163c737571634b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.892180:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1a0c390/0xbd163c737571634b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.892197:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1a0c390/0xbd163c737571634b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836656.892210:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1788836656.892245:0:24263:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:34 00000100:00100000:0.0:1788836656.892341:0:24263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8047445f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22780:x1875730518782592:12345-0@lo:5:osp-pre-0-0.0 Request processed in 68733us (74498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836656.892351:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1788836656.892534:0:22743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836656.892542:0:22743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1a0c390/0xbd163c737571634b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.892550:0:22743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8140031e00 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:1.0:1788836656.892554:0:22743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1a0c390/0xbd163c737571634b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.892562:0:22743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1a0c390/0xbd163c737571634b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.892579:0:22743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1a0c390/0xbd163c737571634b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.892587:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1a0c390/0xbd163c737571634b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836656.892605:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836656.892606:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836656.892608:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836656.892621:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836656.892807:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b055f43/0xbd163c7375716344 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.892825:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b055f43/0xbd163c7375716344 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.892843:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b055f43/0xbd163c7375716344 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.892852:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b055f43/0xbd163c7375716344 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836656.892949:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836656.892952:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836656.892954:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836656.893031:0:22780:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8047447100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22780:1875730518782592:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788836656.893052:0:22780:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x22:0x0] 00000100:00100000:2.0:1788836656.893121:0:22780:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8047447100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22780:1875730518782720:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788836656.893191:0:22780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836656.893233:0:22780:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a817f61a600 going to sleep for 11 seconds 00000100:00100000:0.0:1788836656.894377:0:24573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518782720 00000100:00100000:0.0:1788836656.894396:0:24573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518782720 00000100:00100000:0.0:1788836656.894489:0:24573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788836656.894502:0:24573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8047446a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22780:x1875730518782720:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788836656.894559:0:24573:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00000001:00080000:1.0:1788836656.903325:0:24260:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:1.0:1788836656.903394:0:24260:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788836656.903812:0:24573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8047446a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22780:x1875730518782720:12345-0@lo:5:osp-pre-0-0.0 Request processed in 9305us (10611us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1788836656.903827:0:24573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788836656.903865:0:22780:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:2.0:1788836656.903942:0:22780:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8047447100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22780:1875730518782720:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788836656.903965:0:22780:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00000100:00100000:2.0:1788836656.998712:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788836656.998747:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875730518782848:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788836656.998846:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836656.999085:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518782848 00000100:00100000:1.0:1788836656.999096:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518782848 00000100:00100000:1.0:1788836656.999163:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788836656.999175:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8047447100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875730518782848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788836656.999208:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788836656.999287:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8047447100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875730518782848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836656.999295:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788836656.999352:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875730518782848:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788836657.832953:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836658.021747:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788836658.021779:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8047444700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875730518782976:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788836658.021891:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836658.022072:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518782976 00000100:00100000:2.0:1788836658.022081:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518782976 00000100:00100000:2.0:1788836658.022144:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788836658.022154:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a816bd76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875730518782976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788836658.022199:0:22760:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788836658.022260:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a816bd76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875730518782976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836658.022268:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788836658.023113:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788836658.023127:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875730518783104:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788836658.023169:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836658.023205:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518783104 00000100:00100000:3.0:1788836658.023209:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518783104 00000100:00100000:3.0:1788836658.023242:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788836658.023248:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a816bd75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875730518783104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788836658.023290:0:22761:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788836658.023327:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a816bd75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875730518783104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836658.023334:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788836658.023377:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875730518783104:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788836658.024749:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8047444700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875730518782976:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788836658.853693:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836659.878155:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788836659.945220:0:23516:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788836660.902101:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836661.928126:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788836662.117892:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788836662.117898:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788836662.117902:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a8158dbd800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788836662.117910:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 686 00000100:00080000:2.0:1788836662.117914:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788836662.117921:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a8158dbd800 using connection 192.168.201.144@tcp/0@lo 00000100:00100000:2.0:1788836662.117944:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8047447480 x1875730518783616/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788836662.117996:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788836662.117999:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788836662.118001:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a80475ef000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788836662.118006:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 686 00000100:00080000:2.0:1788836662.118013:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788836662.118017:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a80475ef000 using connection 192.168.201.144@tcp/0@lo 00000100:00100000:2.0:1788836662.118029:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a817f537b80 x1875730518784128/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788836662.118073:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f536680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875730518783744:0@lo:400:kworker.0 00000100:00100000:2.0:1788836662.118135:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836662.118181:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8048e76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875730518784384:0@lo:400:kworker.0 00000100:00100000:2.0:1788836662.118203:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836662.118232:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788836662.118239:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8047444e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d9f3bec-9812-4f3e-be22-5440158bfa78:3618:1875730518783232:0@lo:400:kworker.0 00000100:00100000:2.0:1788836662.118271:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836662.118291:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f537480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875730518783872:0@lo:400:kworker.0 00000100:00100000:2.0:1788836662.118315:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836662.118329:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8048e74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875730518784512:0@lo:400:kworker.0 00000100:00100000:2.0:1788836662.118347:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836662.118375:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518783744 00000100:00100000:2.0:1788836662.118382:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518783744 00000100:00100000:2.0:1788836662.118506:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518784384 00000100:00100000:2.0:1788836662.118510:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518784384 00000100:00100000:2.0:1788836662.118536:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518784512 00000100:00100000:2.0:1788836662.118539:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518784512 00000100:00100000:2.0:1788836662.118556:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788836662.118565:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8048e76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875730518783744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836662.118616:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8048e76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875730518783744:12345-0@lo:400:kworker.0 Request processed in 51us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836662.118623:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788836662.118647:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788836662.118653:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8048e75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875730518784384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836662.118682:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8048e75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875730518784384:12345-0@lo:400:kworker.0 Request processed in 29us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836662.118688:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788836662.118699:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788836662.118704:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8048e77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875730518784512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836662.118728:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8048e77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875730518784512:12345-0@lo:400:kworker.0 Request processed in 25us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836662.118733:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1788836662.118778:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788836662.118781:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788836662.118805:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8048e74e00 x1875730518784512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836678 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836662.118818:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8048e74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875730518784512:0@lo:400:kworker.0 00010000:00080000:2.0:1788836662.118828:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a817f536680 x1875730518783744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836678 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836662.118836:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f536680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875730518783744:0@lo:400:kworker.0 00010000:00080000:2.0:1788836662.118844:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8048e76300 x1875730518784384/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836678 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836662.118852:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8048e76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875730518784384:0@lo:400:kworker.0 00000100:00100000:0.0:1788836662.119083:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8047445500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875730518783360:0@lo:400:kworker.0 00000100:00100000:3.0:1788836662.119103:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518783232 00000100:00100000:3.0:1788836662.119107:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518783232 00000100:00100000:0.0:1788836662.119112:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836662.119133:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f536d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875730518784000:0@lo:400:kworker.0 00000100:00100000:3.0:1788836662.119134:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788836662.119140:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f415050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+21:3618:x1875730518783232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836662.119193:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f415050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+21:3618:x1875730518783232:12345-0@lo:400:kworker.0 Request processed in 54us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836662.119200:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788836662.119227:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518783872 00000100:00100000:3.0:1788836662.119230:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518783872 00000100:00100000:3.0:1788836662.119251:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518783360 00000100:00100000:3.0:1788836662.119253:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518783360 00000100:00100000:3.0:1788836662.119266:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788836662.119271:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8048e75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875730518783872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836662.119299:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8048e75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875730518783872:12345-0@lo:400:kworker.0 Request processed in 29us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836662.119305:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788836662.119315:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788836662.119321:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8181bae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875730518783360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836662.119345:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8181bae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875730518783360:12345-0@lo:400:kworker.0 Request processed in 25us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836662.119361:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788836662.119395:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8047444e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d9f3bec-9812-4f3e-be22-5440158bfa78:3618:1875730518783232:0@lo:400:kworker.0 00000100:00100000:3.0:1788836662.119405:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f537480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875730518783872:0@lo:400:kworker.0 00000100:00100000:0.0:1788836662.119413:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836662.119448:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875730518784640:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788836662.119671:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836662.119705:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518784640 00000100:00100000:2.0:1788836662.119709:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518784640 00000100:00100000:0.0:1788836662.119712:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8047445500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875730518783360:0@lo:400:kworker.0 00000100:00100000:0.0:1788836662.119721:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788836662.119727:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8047444700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875730518783488:0@lo:400:kworker.0 00000100:00100000:0.0:1788836662.119749:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836662.119751:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788836662.119758:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8181bad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875730518784640:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788836662.119766:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8048e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875730518784256:0@lo:400:kworker.0 00002000:00000024:2.0:1788836662.119786:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00080000:3.0:1788836662.119832:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788836662.124102:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8181bad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875730518784640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4336us (4590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836662.124117:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788836662.124203:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836662.124247:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8048e74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875730518784768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788836662.124290:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836662.124350:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518784256 00000100:00100000:2.0:1788836662.124359:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518784256 00000100:00100000:2.0:1788836662.124402:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788836662.124410:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8181baf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875730518784256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836662.124487:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8181baf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875730518784256:12345-0@lo:400:kworker.0 Request processed in 77us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836662.124493:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788836662.124579:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875730518784640:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1788836662.124605:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8048e74000 x1875730518784256/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836678 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836662.124616:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8048e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875730518784256:0@lo:400:kworker.0 00000100:00100000:0.0:1788836662.124641:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8047447480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875730518783616:0@lo:8:kworker.0 00000100:00100000:0.0:1788836662.124673:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836662.124701:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f537b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875730518784128:0@lo:8:kworker.0 00000100:00100000:0.0:1788836662.124721:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836662.124752:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518784000 00000100:00100000:0.0:1788836662.124756:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518784000 00000100:00100000:0.0:1788836662.124778:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518783488 00000100:00100000:0.0:1788836662.124781:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518783488 00000100:00100000:0.0:1788836662.124804:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518783616 00000100:00100000:0.0:1788836662.124807:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518783616 00000100:00100000:0.0:1788836662.124828:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518784128 00000100:00100000:0.0:1788836662.124830:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518784128 00000100:00100000:0.0:1788836662.124975:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788836662.124982:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8181baf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875730518784000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836662.125020:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8181baf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875730518784000:12345-0@lo:400:kworker.0 Request processed in 39us (5863us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836662.125027:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788836662.125040:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788836662.125046:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8181baea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875730518783488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836662.125073:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8181baea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875730518783488:12345-0@lo:400:kworker.0 Request processed in 28us (5324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836662.125079:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788836662.125091:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788836662.125094:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8181baed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3617:x1875730518783616:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788836662.125111:0:24264:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788836662.125142:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8181baed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3617:x1875730518783616:12345-0@lo:8:kworker.0 Request processed in 45us (468us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788836662.125148:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788836662.125159:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788836662.125162:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8181baf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3617:x1875730518784128:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788836662.125172:0:24264:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788836662.125194:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8181baf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3617:x1875730518784128:12345-0@lo:8:kworker.0 Request processed in 30us (472us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788836662.125199:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1788836662.125281:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788836662.125320:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9a8158dbd800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788836662.125325:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788836662.125335:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8047447480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875730518783616:0@lo:8:kworker.0 00000100:00080000:0.0:1788836662.125347:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9a80475ef000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788836662.125350:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788836662.125353:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f537b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875730518784128:0@lo:8:kworker.0 00000100:00100000:0.0:1788836662.125379:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8047444700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875730518783488:0@lo:400:kworker.0 00000100:00100000:0.0:1788836662.125389:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f536d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875730518784000:0@lo:400:kworker.0 00000100:00100000:1.0:1788836662.125794:0:24268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518784768 00000100:00100000:1.0:1788836662.125800:0:24268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518784768 00000100:00100000:1.0:1788836662.125986:0:24268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788836662.125996:0:24268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8181bafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875730518784768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788836662.126011:0:24268:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788836662.126112:0:24268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8181bafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875730518784768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (1820us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836662.126119:0:24268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788836662.127212:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8048e74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875730518784768:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788836662.964768:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836663.146192:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8048e76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875730518785024:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788836663.146276:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836663.146319:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788836663.146327:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8181bac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875730518784896:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788836663.146351:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836663.149798:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518785024 00000100:00100000:3.0:1788836663.149814:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518785024 00000100:00100000:3.0:1788836663.149869:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518784896 00000100:00100000:3.0:1788836663.149872:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518784896 00000100:00100000:3.0:1788836663.149893:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788836663.149903:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8048e74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875730518785024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788836663.149941:0:23498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788836663.150028:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8048e74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875730518785024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 126us (3750us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836663.150035:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788836663.150053:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788836663.150059:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8048e77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875730518784896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788836663.150077:0:23498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788836663.150105:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8048e77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875730518784896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 46us (3753us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836663.150112:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788836663.150165:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8181bac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875730518784896:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788836663.150180:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8048e76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875730518785024:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788836663.973643:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788836664.294451:0:22791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:1.0:1788836664.860082:0:25080:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788836664.860085:0:25080:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788836664.860086:0:25080:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1788836664.860166:0:25080:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a804558d000 00000020:01000004:1.0:1788836664.860178:0:25080:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788836664.860190:0:25080:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788836664.860201:0:25080:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9a8167944d28) 00000020:00000080:1.0:1788836664.860214:0:25080:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788836664.920926:0:25080:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788836664.925615:0:25080:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788836664.926498:0:25080:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788836664.926794:0:25080:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788836664.927440:0:25080:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788836664.928030:0:25080:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788836664.928424:0:25080:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:2.0:1788836664.929941:0:25080:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788836664.930168:0:25080:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788836664.930182:0:25080:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788836664.930194:0:25080:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xbd163c7375716359 00000020:01000004:2.0:1788836664.930200:0:25080:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788836664.930223:0:25080:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.144@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788836664.930226:0:25080:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.144@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788836664.930232:0:25080:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788836664.930260:0:25080:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1788836664.931510:0:25080:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.144@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788836664.961857:0:25080:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.144@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788836664.961905:0:25080:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.144@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788836664.961915:0:25080:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788836664.961916:0:25080:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788836664.961917:0:25080:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788836664.961918:0:25080:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788836664.961919:0:25080:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788836664.961920:0:25080:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788836664.961922:0:25080:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788836664.961924:0:25080:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788836664.961925:0:25080:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788836664.961928:0:25080:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788836664.961930:0:25080:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788836664.961931:0:25080:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788836664.961932:0:25080:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788836664.961933:0:25080:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788836664.961934:0:25080:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788836664.961935:0:25080:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788836664.961936:0:25080:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788836664.961937:0:25080:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788836664.961938:0:25080:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788836664.961965:0:25080:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788836664.961984:0:25080:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd74380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:25080:1875730518785152:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788836664.962055:0:25080:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836664.962101:0:25080:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a817f74c240 going to sleep for 11 seconds 00000100:00100000:1.0:1788836664.962158:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518785152 00000100:00100000:1.0:1788836664.962171:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518785152 00000100:00100000:1.0:1788836664.962226:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788836664.962235:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81446a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+21:25080:x1875730518785152:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788836664.962277:0:22748:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788836664.962280:0:22748:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788836664.962284:0:22748:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788836664.963074:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81446a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+21:25080:x1875730518785152:12345-0@lo:253:mount.lustre.0 Request processed in 837us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836664.963083:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788836664.963165:0:25080:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd74380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:25080:1875730518785152:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788836664.963177:0:25080:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788836664.963179:0:25080:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788836664.963180:0:25080:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788836664.963181:0:25080:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788836664.963182:0:25080:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788836664.963183:0:25080:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788836664.963184:0:25080:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788836664.963186:0:25080:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788836664.963187:0:25080:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788836664.963188:0:25080:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788836664.963207:0:25080:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a804558d000 from lustre-OST0001 10000000:01000000:3.0:1788836664.963235:0:25080:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788836664.963238:0:25080:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788836664.963256:0:25080:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a815f6019b8 local copy 00010000:00010000:3.0:1788836664.963276:0:25080:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a817f41a000/0xbd163c7375715f93 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375715f9a expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836664.963363:0:25080:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd74380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:25080:1875730518785280:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788836664.963407:0:25080:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836664.963442:0:25080:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a817f74ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836664.963525:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518785280 00000100:00100000:0.0:1788836664.963531:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518785280 00000100:00100000:0.0:1788836664.963566:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788836664.963574:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81446a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+21:25080:x1875730518785280:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788836664.963660:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81446a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+21:25080:x1875730518785280:12345-0@lo:501:mount.lustre.0 Request processed in 86us (252us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788836664.963668:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788836664.963752:0:25080:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd74380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:25080:1875730518785280:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788836664.963765:0:25080:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.144@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788836664.963785:0:25080:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.144@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788836664.963791:0:25080:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a817f41a000/0xbd163c7375715f93 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375715f9a expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836664.963799:0:25080:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.144@tcp lock: ffff9a817f41a000/0xbd163c7375715f93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375715f9a expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836664.963836:0:25080:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a804558d000 10000000:01000000:1.0:1788836664.963841:0:25080:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788836664.963847:0:25080:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788836664.963849:0:25080:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788836664.963854:0:25080:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788836664.963856:0:25080:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788836664.963879:0:25080:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a817f41a600/0xbd163c7375716360 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836664.963886:0:25080:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.144@tcp lock: ffff9a817f41a600/0xbd163c7375716360 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836664.963907:0:25080:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.144@tcp lock: ffff9a817f41a600/0xbd163c7375716360 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836664.963919:0:25080:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d95500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:25080:1875730518785408:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788836664.963945:0:25080:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836664.963976:0:25080:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a816c1a7000 going to sleep for 11 seconds 00000100:00100000:0.0:1788836664.964134:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518785408 00000100:00100000:0.0:1788836664.964139:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518785408 00000100:00100000:0.0:1788836664.964172:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788836664.964179:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81446a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+21:25080:x1875730518785408:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788836664.964187:0:22748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836664.964199:0:22748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8140031a00/0xbd163c7375716367 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd163c7375716360 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836664.964220:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8140031a00/0xbd163c7375716367 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd163c7375716360 expref: 22 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836664.964244:0:22748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8140031a00/0xbd163c7375716367 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd163c7375716360 expref: 22 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836664.964253:0:22748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8140031a00, rc 0) 00000100:00100000:0.0:1788836664.964293:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81446a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+22:25080:x1875730518785408:12345-0@lo:101:mount.lustre.0 Request processed in 115us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836664.964300:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788836664.964976:0:25080:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d95500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:25080:1875730518785408:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788836664.964993:0:25080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.144@tcp lock: ffff9a817f41a600/0xbd163c7375716360 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375716367 expref: -99 pid: 25080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836664.965004:0:25080:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.144@tcp lock: ffff9a817f41a600/0xbd163c7375716360 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd163c7375716367 expref: -99 pid: 25080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788836664.967669:0:25080:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:2.0:1788836664.969177:0:25080:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788836664.972122:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1788836664.972180:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1788836664.972196:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1788836664.972211:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1788836664.972225:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1788836664.972238:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1788836664.972258:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1788836664.972285:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1788836664.972302:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:2.0:1788836664.972327:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:2.0:1788836664.972333:0:25080:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:2.0:1788836664.972447:0:25080:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8048e75880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:25080:1875730518785536:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788836664.972564:0:25080:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836664.972618:0:25080:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a815091b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836664.972802:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518785536 00000100:00100000:0.0:1788836664.972811:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518785536 00000100:00100000:0.0:1788836664.972878:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788836664.972889:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81446a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+22:25080:x1875730518785536:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788836664.973043:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81446a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+22:25080:x1875730518785536:12345-0@lo:501:mount.lustre.0 Request processed in 155us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836664.973051:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788836664.973268:0:25080:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8048e75880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:25080:1875730518785536:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788836664.973306:0:25080:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8048e75880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:25080:1875730518785664:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788836664.973349:0:25080:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836664.973421:0:25080:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a815091b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836664.974092:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518785664 00000100:00100000:3.0:1788836664.974098:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518785664 00000100:00100000:2.0:1788836664.974230:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788836664.974239:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81446a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+22:25080:x1875730518785664:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788836664.975219:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81446a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+22:25080:x1875730518785664:12345-0@lo:503:mount.lustre.0 Request processed in 978us (1865us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836664.975228:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788836664.975528:0:25080:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8048e75880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:25080:1875730518785664:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788836664.976213:0:25080:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788836664.976366:0:25080:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d95500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:25080:1875730518785792:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788836664.976986:0:25080:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836664.977102:0:25080:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a816c1a7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788836664.977151:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518785792 00000100:00100000:0.0:1788836664.977159:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518785792 00000100:00100000:0.0:1788836664.977254:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788836664.977275:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81446a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+22:25080:x1875730518785792:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788836664.978144:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81446a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+22:25080:x1875730518785792:12345-0@lo:502:mount.lustre.0 Request processed in 878us (1156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836664.978153:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788836664.978243:0:25080:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d95500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:25080:1875730518785792:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788836664.978513:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1788836664.978559:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1788836664.978576:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1788836664.978590:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1788836664.978616:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1788836664.978631:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1788836664.978644:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1788836664.978656:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1788836664.978669:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:2.0:1788836664.978702:0:25080:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8048e77800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:25080:1875730518785920:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788836664.978759:0:25080:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836664.979455:0:25080:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a815971c000 going to sleep for 11 seconds 00000100:00100000:1.0:1788836664.979593:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518785920 00000100:00100000:1.0:1788836664.979613:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518785920 00000100:00100000:1.0:1788836664.979654:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788836664.979663:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81446a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+22:25080:x1875730518785920:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788836664.979810:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81446a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+22:25080:x1875730518785920:12345-0@lo:502:mount.lustre.0 Request processed in 147us (1049us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836664.979828:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788836664.980157:0:25080:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8048e77800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:25080:1875730518785920:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788836664.980223:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:2.0:1788836664.980243:0:25080:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1788836664.981203:0:25084:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788836664.981212:0:25084:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1788836664.981219:0:25084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836664.981221:0:25084:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788836664.981226:0:25084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788836664.981240:0:25084:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9a8164230000) 00000020:00000080:2.0:1788836664.981273:0:25084:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788836664.981280:0:25084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788836664.981365:0:25084:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a804558d000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788836664.981375:0:25084:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788836664.981390:0:25084:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xbd163c7375716375 00010000:00010000:2.0:1788836664.987247:0:25084:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1788836664.988084:0:25084:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:2.0:1788836664.989702:0:25084:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:2.0:1788836664.991204:0:25084:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788836664.991215:0:25084:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788836664.991222:0:25084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836664.991224:0:25084:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788836664.991228:0:25084:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788836664.991231:0:25084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836664.991233:0:25084:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788836664.991236:0:25084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788836664.991238:0:25084:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788836664.991240:0:25084:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788836664.991243:0:25084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836664.991244:0:25084:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788836664.991246:0:25084:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788836664.991249:0:25084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836664.991250:0:25084:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788836664.991253:0:25084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788836664.991285:0:25084:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788836664.991289:0:25084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836664.991295:0:25084:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788836664.991299:0:25084:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:1.0:1788836664.993425:0:25080:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1788836664.993488:0:25080:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.144@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788836664.993503:0:25080:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a817f41a600/0xbd163c7375716360 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375716367 expref: -99 pid: 25080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836664.993515:0:25080:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.144@tcp lock: ffff9a817f41a600/0xbd163c7375716360 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375716367 expref: -99 pid: 25080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836664.993542:0:25080:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a804558d000 from 1 10000000:01000000:1.0:1788836664.993545:0:25080:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788836664.993582:0:25080:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a817f41aa00/0xbd163c737571637c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836664.993590:0:25080:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.144@tcp lock: ffff9a817f41aa00/0xbd163c737571637c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836664.993612:0:25080:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.144@tcp lock: ffff9a817f41aa00/0xbd163c737571637c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836664.993636:0:25080:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d95c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:25080:1875730518786048:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788836664.993704:0:25080:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836664.993774:0:25080:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a816c1a7840 going to sleep for 11 seconds 00000100:00100000:2.0:1788836664.994015:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518786048 00000100:00100000:2.0:1788836664.994024:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518786048 00000100:00100000:2.0:1788836664.994081:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788836664.994090:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81446a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+22:25080:x1875730518786048:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788836664.994104:0:22748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836664.994116:0:22748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a817ed15400/0xbd163c7375716383 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd163c737571637c expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836664.994139:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a817ed15400/0xbd163c7375716383 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd163c737571637c expref: 23 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836664.994150:0:22748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a817ed15400/0xbd163c7375716383 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd163c737571637c expref: 23 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836664.994159:0:22748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a817ed15400, rc 0) 00000100:00100000:2.0:1788836664.994198:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81446a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+23:25080:x1875730518786048:12345-0@lo:101:mount.lustre.0 Request processed in 109us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836664.994205:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788836664.994720:0:25080:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d95c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:25080:1875730518786048:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788836664.994747:0:25080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.144@tcp lock: ffff9a817f41aa00/0xbd163c737571637c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375716383 expref: -99 pid: 25080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836664.994757:0:25080:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.144@tcp lock: ffff9a817f41aa00/0xbd163c737571637c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd163c7375716383 expref: -99 pid: 25080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788836664.996402:0:25080:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:1.0:1788836664.996725:0:25080:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788836664.997197:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1788836664.997225:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1788836664.997238:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1788836664.997251:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:1.0:1788836664.997401:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:1.0:1788836664.997441:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:1.0:1788836664.997456:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:1.0:1788836664.999706:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:1.0:1788836664.999732:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:1.0:1788836664.999746:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:1.0:1788836664.999761:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:1.0:1788836664.999787:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:1.0:1788836664.999794:0:25080:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:1.0:1788836664.999906:0:25080:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d95c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:25080:1875730518786176:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788836665.000107:0:25080:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836665.000155:0:25080:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a816c1a7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788836665.000402:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518786176 00000100:00100000:3.0:1788836665.000409:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518786176 00000100:00100000:3.0:1788836665.000453:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788836665.000475:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81446a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+23:25080:x1875730518786176:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788836665.000648:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81446a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+23:25080:x1875730518786176:12345-0@lo:501:mount.lustre.0 Request processed in 188us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836665.000654:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788836665.000727:0:25080:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d95c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:25080:1875730518786176:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788836665.000752:0:25080:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d95c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:25080:1875730518786304:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788836665.000788:0:25080:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836665.000814:0:25080:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a816c1a7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788836665.000855:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518786304 00000100:00100000:2.0:1788836665.000861:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518786304 00000100:00100000:2.0:1788836665.000893:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788836665.000901:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81446a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+23:25080:x1875730518786304:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788836665.000994:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81446a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+23:25080:x1875730518786304:12345-0@lo:503:mount.lustre.0 Request processed in 93us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836665.001001:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00010000:2.0:1788836665.001574:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836665.001672:0:25080:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d95c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:25080:1875730518786304:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788836665.002352:0:25080:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788836665.002455:0:25080:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd74380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:25080:1875730518786432:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788836665.002531:0:25080:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836665.002664:0:25080:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a817f74cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788836665.002700:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518786432 00000100:00100000:0.0:1788836665.002707:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518786432 00000100:00100000:0.0:1788836665.002747:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788836665.002756:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81446a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+23:25080:x1875730518786432:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788836665.002880:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81446a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+23:25080:x1875730518786432:12345-0@lo:502:mount.lustre.0 Request processed in 124us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836665.002892:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788836665.003075:0:25080:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd74380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:25080:1875730518786432:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788836665.003284:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1788836665.003309:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1788836665.003324:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1788836665.003336:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1788836665.003349:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1788836665.003370:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1788836665.003394:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1788836665.003410:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:3.0:1788836665.003423:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1788836665.003436:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:3.0:1788836665.003484:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:3.0:1788836665.003509:0:25080:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd74380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:25080:1875730518786560:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788836665.003547:0:25080:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836665.004500:0:25080:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a817f74cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788836665.004574:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518786560 00000100:00100000:2.0:1788836665.004589:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518786560 00000100:00100000:2.0:1788836665.004642:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788836665.004654:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81446a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+23:25080:x1875730518786560:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788836665.005027:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81446a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+23:25080:x1875730518786560:12345-0@lo:502:mount.lustre.0 Request processed in 373us (1477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836665.005037:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788836665.005454:0:25080:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd74380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:25080:1875730518786560:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788836665.005555:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:3.0:1788836665.005567:0:25080:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788836665.011126:0:25088:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788836665.011142:0:25088:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836665.011144:0:25088:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788836665.011151:0:25088:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a804558d000 00000020:00000080:2.0:1788836665.011154:0:25088:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788836665.011164:0:25088:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788836665.011166:0:25088:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836665.011168:0:25088:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788836665.011170:0:25088:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788836665.011173:0:25088:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836665.011174:0:25088:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788836665.011177:0:25088:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a804558d000 00000020:00000080:2.0:1788836665.011179:0:25088:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788836665.011244:0:25088:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788836665.011248:0:25088:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836665.011250:0:25088:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788836665.011252:0:25088:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788836665.011255:0:25088:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836665.011256:0:25088:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788836665.011260:0:25088:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a804558d000 00000020:00000080:2.0:1788836665.011262:0:25088:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788836665.011280:0:25088:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788836665.011283:0:25088:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836665.011285:0:25088:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788836665.011287:0:25088:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788836665.011289:0:25088:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836665.011303:0:25088:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788836665.011307:0:25088:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a804558d000 00000020:00000080:2.0:1788836665.011309:0:25088:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788836665.011334:0:25088:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788836665.011337:0:25088:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788836665.011338:0:25088:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788836665.011342:0:25088:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:0.0:1788836665.012029:0:25080:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788836665.012068:0:25080:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788836665.012096:0:25080:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a817f41aa00/0xbd163c737571637c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375716383 expref: -99 pid: 25080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836665.012111:0:25080:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.144@tcp lock: ffff9a817f41aa00/0xbd163c737571637c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375716383 expref: -99 pid: 25080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836665.012173:0:25080:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788836665.012177:0:25080:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a804558d000 10000000:01000000:0.0:1788836665.012181:0:25080:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a804558d000 10000000:01000000:0.0:1788836665.012185:0:25080:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788836665.012191:0:25080:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a804558d000 from 1 10000000:01000000:0.0:1788836665.012194:0:25080:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788836665.012236:0:25080:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a8140030e00/0xbd163c737571638a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836665.012246:0:25080:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.144@tcp lock: ffff9a8140030e00/0xbd163c737571638a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836665.012258:0:25080:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.144@tcp lock: ffff9a8140030e00/0xbd163c737571638a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836665.012284:0:25080:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8181bad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:25080:1875730518786688:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788836665.012358:0:25080:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836665.012417:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518786688 00000100:00100000:0.0:1788836665.012426:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518786688 00000100:00100000:0.0:1788836665.012501:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788836665.012518:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81446a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+23:25080:x1875730518786688:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788836665.012532:0:22750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836665.012544:0:22750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8140030400/0xbd163c7375716391 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd163c737571638a expref: -99 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836665.012570:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8140030400/0xbd163c7375716391 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd163c737571638a expref: 24 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836665.012581:0:22750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8140030400/0xbd163c7375716391 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd163c737571638a expref: 24 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836665.012589:0:22750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8140030400, rc 0) 00000100:00100000:0.0:1788836665.012622:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81446a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+24:25080:x1875730518786688:12345-0@lo:101:mount.lustre.0 Request processed in 106us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836665.012629:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788836665.012675:0:25080:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a817f5ad000 going to sleep for 11 seconds 00000100:00100000:0.0:1788836665.012699:0:25080:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8181bad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:25080:1875730518786688:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788836665.012714:0:25080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.144@tcp lock: ffff9a8140030e00/0xbd163c737571638a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375716391 expref: -99 pid: 25080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836665.012724:0:25080:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.144@tcp lock: ffff9a8140030e00/0xbd163c737571638a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd163c7375716391 expref: -99 pid: 25080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788836665.021080:0:25080:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1788836665.021372:0:25080:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788836665.021604:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1788836665.021629:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1788836665.021644:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1788836665.021657:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1788836665.021669:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1788836665.021680:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1788836665.021692:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1788836665.021704:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1788836665.021731:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1788836665.021744:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1788836665.021754:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1788836665.021765:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1788836665.021775:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1788836665.021786:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1788836665.021797:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1788836665.021807:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1788836665.021818:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1788836665.021837:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1788836665.021848:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1788836665.021858:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1788836665.021868:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1788836665.021879:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1788836665.021889:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1788836665.021906:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1788836665.021930:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:3.0:1788836665.021946:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:3.0:1788836665.021958:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:3.0:1788836665.021971:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:3.0:1788836665.021983:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:3.0:1788836665.021995:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:3.0:1788836665.022006:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:3.0:1788836665.022018:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:3.0:1788836665.022031:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:3.0:1788836665.022043:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:3.0:1788836665.022055:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:3.0:1788836665.022070:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:3.0:1788836665.022084:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:3.0:1788836665.022097:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:3.0:1788836665.022111:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:3.0:1788836665.022126:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:3.0:1788836665.022156:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:3.0:1788836665.022172:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:3.0:1788836665.022186:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:3.0:1788836665.022198:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:3.0:1788836665.022211:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:3.0:1788836665.022222:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:3.0:1788836665.022235:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:3.0:1788836665.022248:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:3.0:1788836665.022349:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:3.0:1788836665.022370:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:3.0:1788836665.022614:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:3.0:1788836665.022623:0:25080:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:3.0:1788836665.022725:0:25080:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd74380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:25080:1875730518786816:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788836665.022791:0:25080:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836665.022882:0:25080:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8048de3600 going to sleep for 11 seconds 00000100:00100000:1.0:1788836665.022925:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518786816 00000100:00100000:1.0:1788836665.022933:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518786816 00000100:00100000:1.0:1788836665.022981:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788836665.022991:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81446a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+24:25080:x1875730518786816:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788836665.023166:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81446a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+24:25080:x1875730518786816:12345-0@lo:501:mount.lustre.0 Request processed in 176us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836665.023174:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788836665.023242:0:25080:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd74380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:25080:1875730518786816:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788836665.023277:0:25080:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd74380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:25080:1875730518786944:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788836665.023317:0:25080:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836665.023371:0:25080:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8048de3600 going to sleep for 11 seconds 00000100:00100000:1.0:1788836665.023416:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518786944 00000100:00100000:1.0:1788836665.023421:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518786944 00000100:00100000:1.0:1788836665.023446:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788836665.023453:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81446a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+24:25080:x1875730518786944:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788836665.023655:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81446a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+24:25080:x1875730518786944:12345-0@lo:503:mount.lustre.0 Request processed in 201us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836665.023669:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788836665.023734:0:25080:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd74380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:25080:1875730518786944:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788836665.024071:0:25080:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788836665.024142:0:25080:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd74380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:25080:1875730518787072:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788836665.024181:0:25080:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836665.024244:0:25080:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8048de3600 going to sleep for 11 seconds 00000100:00100000:1.0:1788836665.024284:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518787072 00000100:00100000:1.0:1788836665.024289:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518787072 00000100:00100000:1.0:1788836665.024317:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788836665.024325:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8147b90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+24:25080:x1875730518787072:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788836665.024492:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8147b90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+24:25080:x1875730518787072:12345-0@lo:502:mount.lustre.0 Request processed in 167us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836665.024501:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788836665.024578:0:25080:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd74380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:25080:1875730518787072:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788836665.024729:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1788836665.024752:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1788836665.024777:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1788836665.024789:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1788836665.024802:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1788836665.024815:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1788836665.024828:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1788836665.024841:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1788836665.024853:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1788836665.024868:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1788836665.024889:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1788836665.024906:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1788836665.024930:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1788836665.024944:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1788836665.024957:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1788836665.024970:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1788836665.024988:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1788836665.025004:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1788836665.025030:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1788836665.025051:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1788836665.025067:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1788836665.025080:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1788836665.025094:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1788836665.025112:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1788836665.025128:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:3.0:1788836665.025143:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:3.0:1788836665.025159:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:3.0:1788836665.025177:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:3.0:1788836665.025194:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:3.0:1788836665.025215:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:3.0:1788836665.025237:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:3.0:1788836665.025253:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:3.0:1788836665.025270:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:3.0:1788836665.025291:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:3.0:1788836665.025323:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:3.0:1788836665.025346:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:3.0:1788836665.025368:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:3.0:1788836665.025403:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:3.0:1788836665.025426:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:3.0:1788836665.025447:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:3.0:1788836665.025540:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:3.0:1788836665.025562:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:3.0:1788836665.025580:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:3.0:1788836665.025596:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:3.0:1788836665.025612:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:3.0:1788836665.025639:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:3.0:1788836665.025655:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:3.0:1788836665.025670:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:3.0:1788836665.025713:0:25080:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd74380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:25080:1875730518787200:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788836665.025767:0:25080:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836665.025841:0:25080:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8048de3600 going to sleep for 11 seconds 00000100:00100000:1.0:1788836665.025889:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518787200 00000100:00100000:1.0:1788836665.025895:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518787200 00000100:00100000:1.0:1788836665.025931:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788836665.025939:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8147b91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+24:25080:x1875730518787200:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788836665.026210:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8147b91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+24:25080:x1875730518787200:12345-0@lo:502:mount.lustre.0 Request processed in 270us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836665.026219:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788836665.026313:0:25080:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd74380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:25080:1875730518787200:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788836665.026687:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:3.0:1788836665.026719:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:3.0:1788836665.026741:0:25080:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd74380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:25080:1875730518787328:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788836665.026780:0:25080:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836665.026848:0:25080:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8048de3600 going to sleep for 11 seconds 00000100:00100000:1.0:1788836665.026878:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518787328 00000100:00100000:1.0:1788836665.026881:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518787328 00000100:00100000:1.0:1788836665.026905:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788836665.026911:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8147b92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+24:25080:x1875730518787328:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788836665.027035:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8147b92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+24:25080:x1875730518787328:12345-0@lo:502:mount.lustre.0 Request processed in 123us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836665.027043:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788836665.027107:0:25080:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd74380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:25080:1875730518787328:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788836665.027144:0:25080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:3.0:1788836665.027152:0:25080:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788836665.027911:0:25093:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788836665.027938:0:25093:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9a8046703370) 00000020:00000080:1.0:1788836665.027965:0:25093:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1788836665.028063:0:25093:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a804558d000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788836665.028071:0:25093:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a804558d000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788836665.028072:0:25093:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a804558d000 3 00010000:00080000:1.0:1788836665.028101:0:25093:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a8047dd6800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.144@tcp at head 00010000:00010000:1.0:1788836665.033675:0:25093:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1788836665.033905:0:25093:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788836665.033958:0:25093:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788836665.033971:0:25093:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xbd163c737571639f 00000100:00080000:1.0:1788836665.033981:0:25093:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788836665.033987:0:25093:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a8047dd6800 using connection 192.168.201.144@tcp/0@lo 00000100:00100000:1.0:1788836665.034022:0:25093:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8172d94e00 x1875730518787456/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788836665.034047:0:25093:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788836665.034070:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3617:1875730518787456:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788836665.034101:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788836665.034105:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788836665.034108:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a8158dbd800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788836665.034113:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 692 00000100:00080000:1.0:1788836665.034116:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788836665.034121:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a8158dbd800 using connection 192.168.201.144@tcp/0@lo 00000100:00100000:1.0:1788836665.034135:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8172d96300 x1875730518787840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788836665.034141:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836665.034189:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875730518787840:0@lo:8:kworker.0 00000100:00080000:1.0:1788836665.034189:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788836665.034196:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788836665.034198:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a80475ef000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788836665.034202:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 692 00000100:00080000:1.0:1788836665.034205:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788836665.034209:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a80475ef000 using connection 192.168.201.144@tcp/0@lo 00000100:00100000:2.0:1788836665.034216:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836665.034233:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8172d95c00 x1875730518788352/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788836665.034248:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518787456 00000100:00100000:2.0:1788836665.034255:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518787456 00000100:00100000:1.0:1788836665.034289:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875730518787584:0@lo:400:kworker.0 00000100:00100000:2.0:1788836665.034295:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788836665.034304:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8048e77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3617:x1875730518787456:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788836665.034330:0:22755:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 695 last 0 00000100:00100000:1.0:1788836665.034332:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836665.034370:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875730518788224:0@lo:400:kworker.0 00000020:00000080:2.0:1788836665.034389:0:22755:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xbd163c73757163a6 00000004:00100000:2.0:1788836665.034403:0:22755:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788836665.034433:0:22755:0:(import.c:65:import_set_state_nolock()) ffff9a80473cd000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788836665.034495:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8048e77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875730518787456:12345-0@lo:38:llog_process_th.0 Request processed in 192us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836665.034502:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788836665.034662:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836665.034690:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788836665.034695:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875730518787712:0@lo:400:kworker.0 00000100:00100000:1.0:1788836665.034717:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836665.034737:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875730518788480:0@lo:400:kworker.0 00000100:00100000:1.0:1788836665.034768:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836665.034770:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518787840 00000100:00100000:0.0:1788836665.034775:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518787840 00000100:00100000:2.0:1788836665.034793:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518788480 00000100:00100000:2.0:1788836665.034798:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518788480 00000100:00100000:1.0:1788836665.034808:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875730518787968:0@lo:400:kworker.0 00000100:00100000:0.0:1788836665.034823:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518788224 00000100:00100000:0.0:1788836665.034827:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518788224 00000100:00100000:2.0:1788836665.034832:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788836665.034838:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836665.034844:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166d88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875730518788480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836665.034861:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8166d89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875730518788608:0@lo:400:kworker.0 00000100:00100000:3.0:1788836665.034872:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518787712 00000100:00100000:3.0:1788836665.034876:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518787712 00000100:00100000:2.0:1788836665.034894:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166d88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875730518788480:12345-0@lo:400:kworker.0 Request processed in 49us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836665.034895:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836665.034901:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788836665.034912:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166d88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875730518788224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836665.034916:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788836665.034923:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788836665.034933:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518787968 00000100:00100000:1.0:1788836665.034933:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875730518788096:0@lo:400:kworker.0 00000100:00100000:2.0:1788836665.034938:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518787968 00000100:00100000:2.0:1788836665.034956:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518788608 00000100:00100000:2.0:1788836665.034958:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518788608 00000100:00100000:3.0:1788836665.034974:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166d88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875730518788224:12345-0@lo:400:kworker.0 Request processed in 64us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836665.034975:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788836665.034983:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836665.034985:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166d8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875730518787968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836665.034990:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788836665.035009:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788836665.035014:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8166d8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875730518788736:0@lo:400:kworker.0 00000100:00100000:3.0:1788836665.035019:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875730518787712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836665.035022:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166d8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875730518787968:12345-0@lo:400:kworker.0 Request processed in 38us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836665.035029:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788836665.035042:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788836665.035054:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166d89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875730518788608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836665.035058:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836665.035060:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875730518787712:12345-0@lo:400:kworker.0 Request processed in 44us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836665.035074:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788836665.035094:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a8172d94000 x1875730518787968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836665.035097:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788836665.035107:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8048e76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3617:x1875730518787840:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788836665.035110:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166d89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875730518788608:12345-0@lo:400:kworker.0 Request processed in 61us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836665.035115:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875730518787968:0@lo:400:kworker.0 00000100:00100000:2.0:1788836665.035119:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788836665.035137:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518788736 00010000:00080000:1.0:1788836665.035137:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a8166d89c00 x1875730518788608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836665.035140:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518788736 00000100:00100000:3.0:1788836665.035150:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8048e76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3617:x1875730518787840:12345-0@lo:8:kworker.0 Request processed in 42us (932us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788836665.035156:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788836665.035159:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8166d89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875730518788608:0@lo:400:kworker.0 00000100:00100000:3.0:1788836665.035164:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788836665.035167:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a80455a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875730518788736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836665.035205:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518787584 00000100:00100000:2.0:1788836665.035209:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a80455a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875730518788736:12345-0@lo:400:kworker.0 Request processed in 44us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836665.035214:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1788836665.035254:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788836665.035257:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788836665.035264:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788836665.035532:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518787584 00000100:00100000:1.0:1788836665.035564:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518788096 00000100:00100000:1.0:1788836665.035567:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518788096 00000100:00100000:1.0:1788836665.035580:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788836665.035586:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166d8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875730518787584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836665.035629:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788836665.035636:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a80455a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875730518788096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836665.035669:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a80455a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875730518788096:12345-0@lo:400:kworker.0 Request processed in 34us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836665.035674:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788836665.035735:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166d8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875730518787584:12345-0@lo:400:kworker.0 Request processed in 147us (1403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836665.035743:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788836665.035787:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875730518787712:0@lo:400:kworker.0 00010000:00080000:1.0:1788836665.035804:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a8172d95500 x1875730518788480/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836665.035814:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875730518788480:0@lo:400:kworker.0 00000100:00100000:1.0:1788836665.035829:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875730518787584:0@lo:400:kworker.0 00000100:00100000:1.0:1788836665.035846:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875730518788224:0@lo:400:kworker.0 00000100:00100000:1.0:1788836665.035895:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875730518788096:0@lo:400:kworker.0 00010000:00080000:1.0:1788836665.035905:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a8166d8b800 x1875730518788736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836665.035918:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8166d8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875730518788736:0@lo:400:kworker.0 00000100:00100000:1.0:1788836665.035943:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875730518788352:0@lo:8:kworker.0 00000100:00100000:1.0:1788836665.035970:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836665.036049:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788836665.036055:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9a8158dbd800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788836665.036059:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788836665.036062:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875730518787840:0@lo:8:kworker.0 00010000:00080000:1.0:1788836665.036079:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a8172d94e00 x1875730518787456/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788836675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836665.036086:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788836665.036092:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1788836665.036099:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788836665.036104:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788836665.036108:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9a8047dd6800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788836665.036113:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3617:1875730518787456:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788836665.038075:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518788352 00000100:00100000:3.0:1788836665.038089:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518788352 00000100:00100000:3.0:1788836665.038134:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788836665.038143:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a80455a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3617:x1875730518788352:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788836665.038237:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a80455a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3617:x1875730518788352:12345-0@lo:8:kworker.0 Request processed in 94us (2265us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788836665.038245:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788836665.038263:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788836665.038270:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9a80475ef000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788836665.038275:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788836665.038279:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875730518788352:0@lo:8:kworker.0 00000020:01000004:0.0:1788836665.038578:0:25093:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788836665.038594:0:25093:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9a817f4d99b8) 00000020:00000080:0.0:1788836665.038617:0:25093:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1788836665.038734:0:25093:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a804558d000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788836665.038739:0:25093:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a804558d000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788836665.038741:0:25093:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a804558d000 3 00010000:00080000:0.0:1788836665.038771:0:25093:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a80475ed000@lustre-MDT0001-lwp-OST0001: add connection 192.168.201.144@tcp at head 00010000:00010000:0.0:1788836665.040404:0:25093:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1788836665.040701:0:25093:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1788836665.040753:0:25093:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788836665.040766:0:25093:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xbd163c73757163b4 00000100:00080000:0.0:1788836665.040778:0:25093:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788836665.040784:0:25093:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9a80475ed000 using connection 192.168.201.144@tcp/0@lo 00000100:00100000:0.0:1788836665.040820:0:25093:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8181bad880 x1875730518788864/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788836665.040854:0:25093:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788836665.040987:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8181bad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3617:1875730518788864:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788836665.041053:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1788836665.041116:0:25093:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000100:00100000:1.0:1788836665.041127:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518788864 00000100:00100000:1.0:1788836665.041133:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518788864 00000100:00100000:1.0:1788836665.041163:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788836665.041171:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a80455a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3617:x1875730518788864:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788836665.041192:0:22756:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 695 last 0 00000020:00000080:1.0:1788836665.041226:0:22756:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xbd163c73757163bb 00000004:00100000:1.0:1788836665.041241:0:22756:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788836665.041275:0:22756:0:(import.c:65:import_set_state_nolock()) ffff9a8047dd3800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788836665.041321:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a80455a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875730518788864:12345-0@lo:38:llog_process_th.0 Request processed in 151us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836665.041327:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788836665.041358:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a8181bad880 x1875730518788864/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788836675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836665.041369:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788836665.041376:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:0.0:1788836665.041396:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788836665.041400:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788836665.041408:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9a80475ed000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788836665.041414:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8181bad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3617:1875730518788864:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1788836665.041501:0:25080:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788836665.041529:0:25080:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788836665.041545:0:25080:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a8140030e00/0xbd163c737571638a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375716391 expref: -99 pid: 25080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836665.041560:0:25080:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.144@tcp lock: ffff9a8140030e00/0xbd163c737571638a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375716391 expref: -99 pid: 25080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788836665.041614:0:25080:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788836665.041617:0:25080:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788836665.041619:0:25080:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788836665.041620:0:25080:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788836665.041622:0:25080:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788836665.041623:0:25080:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788836665.041624:0:25080:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788836665.041627:0:25080:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788836665.041629:0:25080:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788836665.041633:0:25080:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788836665.041635:0:25080:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788836665.041637:0:25080:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788836665.041638:0:25080:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788836665.041639:0:25080:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788836665.041640:0:25080:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788836665.041643:0:25080:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788836665.041644:0:25080:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788836665.041646:0:25080:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788836665.041647:0:25080:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788836665.041663:0:25080:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788836665.041678:0:25080:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8048e74a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:25080:1875730518788992:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788836665.041724:0:25080:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836665.046665:0:25080:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a81546d7a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788836665.047123:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518788992 00000100:00100000:1.0:1788836665.047132:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518788992 00000100:00100000:0.0:1788836665.047215:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788836665.047224:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8147b90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+24:25080:x1875730518788992:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788836665.047251:0:22750:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788836665.047264:0:22750:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788836665.057000:0:22750:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788836665.057017:0:22750:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788836665.057259:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8147b90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+24:25080:x1875730518788992:12345-0@lo:253:mount.lustre.0 Request processed in 10031us (15531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836665.057269:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788836665.057349:0:25080:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8048e74a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5d9f3bec-9812-4f3e-be22-5440158bfa78:25080:1875730518788992:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788836665.057361:0:25080:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788836665.057363:0:25080:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788836665.057365:0:25080:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788836665.057366:0:25080:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788836665.057367:0:25080:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788836665.057368:0:25080:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788836665.057369:0:25080:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788836665.057370:0:25080:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788836665.057371:0:25080:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788836665.057378:0:25080:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788836665.057401:0:25080:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1788836665.057716:0:22771:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788836665.057722:0:22771:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788836665.057743:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a817ed15000/0xbd163c73757163c2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836665.057759:0:22771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a804738d600/0xbd163c7375716256 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd163c737571624f expref: 23 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836665.057783:0:22771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8167974400/0xbd163c7375716264 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd163c737571625d expref: 23 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836665.057790:0:22771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a817ed15000/0xbd163c73757163c2 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836665.057823:0:22771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8167974400/0xbd163c7375716264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd163c737571625d expref: 23 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836665.057837:0:22771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8167974400/0xbd163c7375716264 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd163c737571625d expref: 23 pid: 22750 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836665.057852:0:22771:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8048e76d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22771:1875730518789120:0@lo:104: 00000100:00100000:2.0:1788836665.057901:0:22771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788836665.057943:0:22771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a804738d600/0xbd163c7375716256 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd163c737571624f expref: 23 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836665.057952:0:22771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a804738d600/0xbd163c7375716256 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd163c737571624f expref: 23 pid: 22750 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836665.057966:0:22771:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8048e74380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22771:1875730518789248:0@lo:104: 00000100:00100000:2.0:1788836665.057989:0:22771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836665.058012:0:22771:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8148f62600 going to sleep for 11 seconds 00000100:00100000:3.0:1788836665.058059:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518789120 00000100:00100000:3.0:1788836665.058065:0:22738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518789120 00000100:00100000:3.0:1788836665.058089:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518789248 00000100:00100000:3.0:1788836665.058092:0:22738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518789248 00000100:00100000:3.0:1788836665.058108:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788836665.058116:0:22738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8048e75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d9f3bec-9812-4f3e-be22-5440158bfa78+4:22771:x1875730518789120:12345-0@lo:104: 00010000:00010000:3.0:1788836665.058129:0:22738:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.144@tcp lock: ffff9a8167974c00/0xbd163c737571625d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd163c7375716264 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836665.058193:0:22738:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788836665.058201:0:22738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8048e75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d9f3bec-9812-4f3e-be22-5440158bfa78+4:22771:x1875730518789120:12345-0@lo:104: Request processed in 84us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836665.058209:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788836665.058209:0:22771:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8048e76d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22771:1875730518789120:0@lo:104: 00000100:00100000:1.0:1788836665.058509:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788836665.058518:0:22739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8048e75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d9f3bec-9812-4f3e-be22-5440158bfa78+4:22771:x1875730518789248:12345-0@lo:104: 00010000:00010000:1.0:1788836665.058525:0:22739:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.144@tcp lock: ffff9a817f41b600/0xbd163c737571624f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd163c7375716256 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836665.058571:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836665.058578:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.144@tcp lock: ffff9a8167974c00/0xbd163c737571625d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd163c7375716264 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836665.058586:0:22771:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8048e74380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22771:1875730518789248:0@lo:104: 00010000:00010000:3.0:1788836665.058587:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8167974c00 already unused, calling callback (ffffffffc139ec20) 10000000:00010000:3.0:1788836665.058592:0:22744:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.144@tcp lock: ffff9a8167974c00/0xbd163c737571625d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd163c7375716264 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836665.058598:0:22739:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1788836665.058601:0:22744:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.144@tcp lock: ffff9a8167974c00/0xbd163c737571625d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd163c7375716264 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836665.058606:0:22739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8048e75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5d9f3bec-9812-4f3e-be22-5440158bfa78+3:22771:x1875730518789248:12345-0@lo:104: Request processed in 88us (615us total) trans 0 rc 0/0 00010000:00010000:2.0:1788836665.058609:0:22771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a817ed15000/0xbd163c73757163c2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788836665.058615:0:22744:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.144@tcp lock: ffff9a8167974c00/0xbd163c737571625d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd163c7375716264 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836665.058619:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 10000000:01000000:3.0:1788836665.058632:0:22744:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788836665.058668:0:22744:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.144@tcp lock: ffff9a8167974c00/0xbd163c737571625d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd163c7375716264 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836665.058683:0:22744:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788836665.058716:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.144@tcp lock: ffff9a8167974c00/0xbd163c737571625d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd163c7375716264 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836665.058723:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.144@tcp lock: ffff9a8167974c00/0xbd163c737571625d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd163c7375716264 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836665.058734:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1788836665.058736:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788836665.058741:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.144@tcp lock: ffff9a817f41b600/0xbd163c737571624f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd163c7375716256 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836665.058749:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a817f41b600 already unused, calling callback (ffffffffc139ec20) 00000100:00100000:2.0:1788836665.058750:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a816bd74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d9f3bec-9812-4f3e-be22-5440158bfa78:3621:1875730518789376:0@lo:103:ldlm_bl.0 10000000:00010000:3.0:1788836665.058754:0:22744:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.144@tcp lock: ffff9a817f41b600/0xbd163c737571624f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd163c7375716256 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836665.058764:0:22744:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.144@tcp lock: ffff9a817f41b600/0xbd163c737571624f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd163c7375716256 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788836665.058770:0:22744:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.144@tcp lock: ffff9a817f41b600/0xbd163c737571624f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd163c7375716256 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788836665.058775:0:22744:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:2.0:1788836665.058802:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788836665.058805:0:22744:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.144@tcp lock: ffff9a817f41b600/0xbd163c737571624f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd163c7375716256 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836665.058811:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836665.058812:0:22744:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788836665.058829:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.144@tcp lock: ffff9a817f41b600/0xbd163c737571624f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd163c7375716256 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836665.058837:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.144@tcp lock: ffff9a817f41b600/0xbd163c737571624f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd163c7375716256 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836665.058839:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8047444700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d9f3bec-9812-4f3e-be22-5440158bfa78:3621:1875730518789504:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788836665.058861:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836665.058864:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788836665.058868:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836665.058869:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836665.058903:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518789376 00000100:00100000:3.0:1788836665.058909:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518789376 00000100:00100000:2.0:1788836665.058916:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518789504 00000100:00100000:2.0:1788836665.058923:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518789504 00010000:00010000:2.0:1788836665.058945:0:22740:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a804738d600/0xbd163c7375716256 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd163c737571624f expref: 25 pid: 22750 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836665.058946:0:22741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8167974400/0xbd163c7375716264 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd163c737571625d expref: 25 pid: 22750 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836665.058977:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788836665.058985:0:22741:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788836665.058986:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8048e76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d9f3bec-9812-4f3e-be22-5440158bfa78+25:3621:x1875730518789504:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788836665.058995:0:22741:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1788836665.059001:0:22740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836665.059008:0:22740:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a804738d600/0xbd163c7375716256 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd163c737571624f expref: 25 pid: 22750 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836665.059019:0:22740:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a804738d600/0xbd163c7375716256 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd163c737571624f expref: 25 pid: 22750 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836665.059031:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a804738d600/0xbd163c7375716256 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd163c737571624f expref: 25 pid: 22750 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836665.059043:0:22740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836665.059078:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8048e76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d9f3bec-9812-4f3e-be22-5440158bfa78+24:3621:x1875730518789504:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836665.059085:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788836665.059102:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788836665.059117:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8048e74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d9f3bec-9812-4f3e-be22-5440158bfa78+23:3621:x1875730518789376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788836665.059125:0:22740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836665.059129:0:22740:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8167974400/0xbd163c7375716264 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd163c737571625d expref: 23 pid: 22750 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836665.059140:0:22740:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8167974400/0xbd163c7375716264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd163c737571625d expref: 23 pid: 22750 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836665.059151:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8167974400/0xbd163c7375716264 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd163c737571625d expref: 23 pid: 22750 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836665.059161:0:22740:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a817ed15000/0xbd163c73757163c2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836665.059169:0:22740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a817ed15000/0xbd163c73757163c2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788836665.059180:0:22740:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007056197s 00010000:00010000:2.0:1788836665.059184:0:22740:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a817ed15000/0xbd163c73757163c2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836665.059191:0:22740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a817ed15000/0xbd163c73757163c2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836665.059197:0:22740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a817ed15000/0xbd163c73757163c2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836665.059203:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a817ed15000/0xbd163c73757163c2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836665.059209:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a817ed15000 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:2.0:1788836665.059219:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a817ed15000/0xbd163c73757163c2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836665.059227:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a817ed15000/0xbd163c73757163c2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836665.059243:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8047444700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d9f3bec-9812-4f3e-be22-5440158bfa78:3621:1875730518789504:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788836665.059251:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a817ed15000/0xbd163c73757163c2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836665.059260:0:22771:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a817ed15000/0xbd163c73757163c2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836665.059261:0:22740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788836665.059270:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a817ed15000/0xbd163c73757163c2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836665.059278:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a817ed15000/0xbd163c73757163c2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836665.059298:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8048e74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d9f3bec-9812-4f3e-be22-5440158bfa78+22:3621:x1875730518789376:12345-0@lo:103:ldlm_bl.0 Request processed in 181us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836665.059306:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000001:00000004:0.0:1788836665.059408:0:25080:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:1.0:1788836665.059439:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a816bd74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d9f3bec-9812-4f3e-be22-5440158bfa78:3621:1875730518789376:0@lo:103:ldlm_bl.0 00002000:00080000:0.0:1788836665.062164:0:25080:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788836665.062172:0:25080:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788836665.062204:0:25080:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788836665.062239:0:25080:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.144@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788836665.062257:0:25080:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1788836665.062272:0:25080:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1788836665.063890:0:25080:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788836665.064192:0:25080:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:1.0:1788836665.737447:0:25147:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788836665.737818:0:25147:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788836666.021655:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788836666.156992:0:22752:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788836666.157000:0:22752:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a80471cd800 from 14 10000000:01000000:0.0:1788836666.157005:0:22752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788836666.157051:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a8140030c00/0xbd163c73757163c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836666.157063:0:22752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.144@tcp lock: ffff9a8140030c00/0xbd163c73757163c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836666.157075:0:22752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.144@tcp lock: ffff9a8140030c00/0xbd163c73757163c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836666.157100:0:22752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8181bad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518789632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788836666.157174:0:22752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836666.157221:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a804641e900 going to sleep for 11 seconds 00000100:00100000:1.0:1788836666.157277:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518789632 00000100:00100000:1.0:1788836666.157285:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518789632 00000100:00100000:1.0:1788836666.157343:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788836666.157353:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81597d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+22:22752:x1875730518789632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788836666.157379:0:22748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836666.157394:0:22748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a817f41ac00/0xbd163c73757163d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd163c73757163c9 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836666.157419:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a817f41ac00/0xbd163c73757163d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd163c73757163c9 expref: 23 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836666.157431:0:22748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a817f41ac00/0xbd163c73757163d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd163c73757163c9 expref: 23 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836666.157496:0:22748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a817f41ac00, rc 0) 00000100:00100000:1.0:1788836666.157556:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81597d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+23:22752:x1875730518789632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 204us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836666.157563:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788836666.157658:0:22752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8181bad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518789632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788836666.157673:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.144@tcp lock: ffff9a8140030c00/0xbd163c73757163c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c73757163d0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836666.157683:0:22752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.144@tcp lock: ffff9a8140030c00/0xbd163c73757163c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd163c73757163d0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836666.157725:0:22752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8047447480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518789760:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788836666.157749:0:22752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836666.157768:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a816c1a7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788836666.157904:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518789760 00000100:00100000:0.0:1788836666.157909:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518789760 00000100:00100000:0.0:1788836666.157945:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788836666.157952:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81597db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+23:22752:x1875730518789760:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788836666.157964:0:22749:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788836666.157982:0:22749:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788836666.157986:0:22749:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:0.0:1788836666.158060:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81597db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+23:22752:x1875730518789760:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 109us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836666.158068:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788836666.158099:0:22752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8047447480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518789760:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788836666.158169:0:22752:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788836666.158175:0:22752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a8140030c00/0xbd163c73757163c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c73757163d0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836666.158192:0:22752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.144@tcp lock: ffff9a8140030c00/0xbd163c73757163c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c73757163d0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836666.158201:0:22752:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788836666.158203:0:22752:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a8166ee6000 from 14 10000000:01000000:0.0:1788836666.158206:0:22752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788836666.158222:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a8140030000/0xbd163c73757163d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836666.158229:0:22752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.144@tcp lock: ffff9a8140030000/0xbd163c73757163d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836666.158237:0:22752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.144@tcp lock: ffff9a8140030000/0xbd163c73757163d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836666.158250:0:22752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8181badf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518789888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788836666.158275:0:22752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836666.158296:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a804641e180 going to sleep for 11 seconds 00000100:00100000:0.0:1788836666.158307:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518789888 00000100:00100000:0.0:1788836666.158310:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518789888 00000100:00100000:0.0:1788836666.158327:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788836666.158333:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81597d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+23:22752:x1875730518789888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788836666.158340:0:22749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836666.158348:0:22749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8140031e00/0xbd163c73757163de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd163c73757163d7 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836666.158373:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8140031e00/0xbd163c73757163de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd163c73757163d7 expref: 24 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836666.158392:0:22749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8140031e00/0xbd163c73757163de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd163c73757163d7 expref: 24 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836666.158399:0:22749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8140031e00, rc 0) 00000100:00100000:0.0:1788836666.158424:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81597d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+24:22752:x1875730518789888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836666.158429:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788836666.158615:0:22752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8181badf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518789888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788836666.158625:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.144@tcp lock: ffff9a8140030000/0xbd163c73757163d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c73757163de expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836666.158633:0:22752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.144@tcp lock: ffff9a8140030000/0xbd163c73757163d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd163c73757163de expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836666.158665:0:22752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8181badf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518790016:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788836666.158689:0:22752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836666.158703:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a804641e180 going to sleep for 11 seconds 00000100:00100000:1.0:1788836666.158933:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518790016 00000100:00100000:1.0:1788836666.158937:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518790016 00000100:00100000:1.0:1788836666.158965:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788836666.158971:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81597dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+24:22752:x1875730518790016:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788836666.158981:0:22749:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788836666.158991:0:22749:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788836666.158994:0:22749:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1788836666.159066:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81597dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+24:22752:x1875730518790016:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 95us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836666.159072:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788836666.159596:0:22752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8181badf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518790016:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788836666.159644:0:22752:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788836666.159650:0:22752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a8140030000/0xbd163c73757163d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c73757163de expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836666.159659:0:22752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.144@tcp lock: ffff9a8140030000/0xbd163c73757163d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c73757163de expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836667.052209:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836667.238510:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8181badf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875730518790144:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788836667.238597:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836667.238654:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788836667.238660:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a80455a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875730518790272:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788836667.238682:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836667.238942:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518790144 00000100:00100000:3.0:1788836667.238951:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518790144 00000100:00100000:3.0:1788836667.238992:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518790272 00000100:00100000:3.0:1788836667.238994:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518790272 00000100:00100000:3.0:1788836667.239012:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788836667.239022:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a80455a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875730518790144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788836667.239051:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788836667.239100:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a80455a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875730518790144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836667.239116:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788836667.239133:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788836667.239139:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a80455a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875730518790272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788836667.239152:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788836667.239175:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a80455a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875730518790272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836667.239181:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788836667.239218:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a80455a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875730518790272:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788836667.239231:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8181badf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875730518790144:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788836667.239457:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788836668.083995:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836668.264553:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8048e77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875730518790400:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788836668.264624:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836668.264818:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518790400 00000100:00100000:2.0:1788836668.264826:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518790400 00000100:00100000:2.0:1788836668.264883:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788836668.264893:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a80455a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875730518790400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788836668.264932:0:22760:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788836668.264973:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a80455a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875730518790400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836668.264989:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788836668.265419:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8048e77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875730518790400:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788836668.265821:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8181badf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875730518790528:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788836668.265872:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836668.266072:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518790528 00000100:00100000:0.0:1788836668.266091:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518790528 00000100:00100000:0.0:1788836668.266132:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788836668.266139:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8047445500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875730518790528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788836668.266162:0:22761:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788836668.266209:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8047445500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875730518790528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836668.266216:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788836668.266414:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8181badf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875730518790528:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788836669.093741:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788836669.160101:0:23516:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788836670.120211:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788836670.315376:0:16590:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788836670.315384:0:16590:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788836670.315389:0:16590:0:(import.c:65:import_set_state_nolock()) ffff9a8158dbd800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788836670.315402:0:16590:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a8158dbd800 using connection 192.168.201.144@tcp/0@lo 00000100:00100000:3.0:1788836670.315437:0:16590:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a804724dc00 x1875730518791040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788836670.315773:0:16590:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788836670.315776:0:16590:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788836670.315778:0:16590:0:(import.c:65:import_set_state_nolock()) ffff9a80475ef000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788836670.315794:0:16590:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a80475ef000 using connection 192.168.201.144@tcp/0@lo 00000100:00100000:3.0:1788836670.315809:0:16590:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a804724c380 x1875730518791552/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788836670.315892:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8047444e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d9f3bec-9812-4f3e-be22-5440158bfa78:3618:1875730518790656:0@lo:400:kworker.0 00000100:00100000:3.0:1788836670.315979:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836670.316035:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a804724df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875730518791296:0@lo:400:kworker.0 00000100:00100000:3.0:1788836670.316065:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836670.316087:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a804724f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875730518791936:0@lo:400:kworker.0 00000100:00100000:3.0:1788836670.316114:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836670.316143:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788836670.316150:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8047447480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875730518790784:0@lo:400:kworker.0 00000100:00100000:3.0:1788836670.316173:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836670.316192:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a804724e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875730518791424:0@lo:400:kworker.0 00000100:00100000:3.0:1788836670.316217:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836670.316237:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a804724f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875730518792064:0@lo:400:kworker.0 00000100:00100000:3.0:1788836670.316261:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836670.316305:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a804724ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875730518791168:0@lo:400:kworker.0 00000100:00100000:3.0:1788836670.316326:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836670.316343:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a804724ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1875730518791808:0@lo:400:kworker.0 00000100:00100000:3.0:1788836670.316362:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836670.316378:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788836670.316382:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8047444700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875730518790912:0@lo:400:kworker.0 00000100:00100000:3.0:1788836670.316403:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836670.316419:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a804724d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875730518791680:0@lo:400:kworker.0 00000100:00100000:3.0:1788836670.316447:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836670.316457:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a804724d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1875730518792192:0@lo:400:kworker.0 00000100:00100000:3.0:1788836670.316511:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836670.316530:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a804724dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875730518791040:0@lo:8:kworker.0 00000100:00100000:3.0:1788836670.316551:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836670.316567:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a804724c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875730518791552:0@lo:8:kworker.0 00000100:00100000:3.0:1788836670.316585:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836670.316616:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518790656 00000100:00100000:3.0:1788836670.316623:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518790656 00000100:00100000:3.0:1788836670.316922:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788836670.316932:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81597d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+24:3618:x1875730518790656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836670.316990:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81597d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+24:3618:x1875730518790656:12345-0@lo:400:kworker.0 Request processed in 60us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836670.316997:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788836670.317031:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518791296 00000100:00100000:3.0:1788836670.317036:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518791296 00000100:00100000:3.0:1788836670.317058:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518790784 00000100:00100000:3.0:1788836670.317061:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518790784 00000100:00100000:3.0:1788836670.317074:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788836670.317079:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81412ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875730518791296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836670.317132:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81412ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875730518791296:12345-0@lo:400:kworker.0 Request processed in 52us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836670.317138:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788836670.317150:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788836670.317156:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81412e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875730518790784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836670.317182:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81412e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875730518790784:12345-0@lo:400:kworker.0 Request processed in 27us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836670.317196:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788836670.317215:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518791936 00000100:00100000:3.0:1788836670.317219:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518791936 00000100:00100000:3.0:1788836670.317263:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518792064 00000100:00100000:3.0:1788836670.317266:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518792064 00000100:00100000:3.0:1788836670.317280:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518791168 00000100:00100000:3.0:1788836670.317282:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518791168 00000100:00100000:3.0:1788836670.317314:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518791808 00000100:00100000:3.0:1788836670.317317:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518791808 00000100:00100000:3.0:1788836670.317339:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518791680 00000100:00100000:3.0:1788836670.317341:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518791680 00000100:00100000:3.0:1788836670.317352:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518792192 00000100:00100000:3.0:1788836670.317354:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518792192 00000100:00100000:3.0:1788836670.317369:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788836670.317375:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81412eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875730518791936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836670.317408:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81412eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875730518791936:12345-0@lo:400:kworker.0 Request processed in 33us (1294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836670.317414:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788836670.317427:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788836670.317432:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81412eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875730518792064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836670.317478:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81412eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875730518792064:12345-0@lo:400:kworker.0 Request processed in 27us (1197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836670.317728:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788836670.317744:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788836670.317752:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81412eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875730518791168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836670.317798:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81412eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875730518791168:12345-0@lo:400:kworker.0 Request processed in 48us (1470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836670.317804:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788836670.317896:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788836670.317903:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f50e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875730518791808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836670.317950:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f50e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875730518791808:12345-0@lo:400:kworker.0 Request processed in 48us (1586us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836670.317957:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788836670.317970:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788836670.317976:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f50f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875730518791680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836670.318003:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f50f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875730518791680:12345-0@lo:400:kworker.0 Request processed in 28us (1555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836670.318008:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788836670.318019:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788836670.318025:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f50f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875730518792192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836670.318050:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f50f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875730518792192:12345-0@lo:400:kworker.0 Request processed in 26us (1539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836670.318056:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788836670.318085:0:24573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518791424 00000100:00100000:3.0:1788836670.318089:0:24573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518791424 00000100:00100000:3.0:1788836670.318109:0:24573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518790912 00000100:00100000:3.0:1788836670.318112:0:24573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518790912 00000100:00100000:3.0:1788836670.318124:0:24573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518791040 00000100:00100000:3.0:1788836670.318127:0:24573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518791040 00000100:00100000:3.0:1788836670.318135:0:24573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518791552 00000100:00100000:3.0:1788836670.318138:0:24573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518791552 00000100:00100000:3.0:1788836670.318146:0:24573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788836670.318153:0:24573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81412e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1875730518791424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836670.318183:0:24573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81412e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1875730518791424:12345-0@lo:400:kworker.0 Request processed in 31us (1965us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836670.318197:0:24573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788836670.318209:0:24573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788836670.318215:0:24573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f50d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1875730518790912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836670.318244:0:24573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f50d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1875730518790912:12345-0@lo:400:kworker.0 Request processed in 30us (1841us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836670.318249:0:24573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788836670.318262:0:24573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788836670.318266:0:24573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f50df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3617:x1875730518791040:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788836670.318310:0:24573:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 700 last 0 00000020:00000080:3.0:1788836670.318342:0:24573:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbd163c73757163e5 00002000:00100000:3.0:1788836670.318358:0:24573:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9a804765a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396b ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788836670.318362:0:24573:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788836670.318365:0:24573:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1788836670.318599:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788836670.318607:0:24263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f50dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3617:x1875730518791552:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788836670.318625:0:24263:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 700 last 0 00000020:00000080:0.0:1788836670.318656:0:24263:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xbd163c73757163ec 00002000:00100000:0.0:1788836670.318662:0:24263:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9a8047590000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396b ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1788836670.318666:0:24263:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1788836670.318668:0:24263:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788836670.318699:0:24263:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1788836670.318724:0:24263:0:(import.c:65:import_set_state_nolock()) ffff9a8047592000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788836670.318771:0:24263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f50dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3617:x1875730518791552:12345-0@lo:8:kworker.0 Request processed in 163us (2184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836670.318778:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788836670.318933:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a804724c380 x1875730518791552/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788836695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788836670.318952:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1788836670.318960:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788836670.318965:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788836670.318967:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9a80475ef000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788836670.318991:0:3617:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788836670.319006:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a804724c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875730518791552:0@lo:8:kworker.0 00000100:00100000:2.0:1788836670.319108:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8047444700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875730518790912:0@lo:400:kworker.0 00010000:00080000:2.0:1788836670.319122:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a804724d880 x1875730518791680/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836670.319130:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a804724d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875730518791680:0@lo:400:kworker.0 00010000:00080000:2.0:1788836670.319144:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a804724d500 x1875730518792192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836670.319164:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a804724d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1875730518792192:0@lo:400:kworker.0 00010000:00080000:2.0:1788836670.319176:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a804724ed80 x1875730518791168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836670.319182:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a804724ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875730518791168:0@lo:400:kworker.0 00010000:00080000:2.0:1788836670.319192:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a804724ce00 x1875730518791808/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836670.319200:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a804724ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1875730518791808:0@lo:400:kworker.0 00002000:00080000:3.0:1788836670.319344:0:24573:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788836670.319360:0:24573:0:(import.c:65:import_set_state_nolock()) ffff9a8047659800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788836670.319408:0:24573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f50df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3617:x1875730518791040:12345-0@lo:8:kworker.0 Request processed in 1140us (2856us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836670.319415:0:24573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:3.0:1788836670.319449:0:23501:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1788836670.319535:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8047447480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875730518790784:0@lo:400:kworker.0 00000100:00100000:2.0:1788836670.319546:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a804724e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875730518791424:0@lo:400:kworker.0 00010000:00080000:2.0:1788836670.319558:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a804724f800 x1875730518792064/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836670.319567:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a804724f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875730518792064:0@lo:400:kworker.0 00000100:00100000:2.0:1788836670.319577:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8047444e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d9f3bec-9812-4f3e-be22-5440158bfa78:3618:1875730518790656:0@lo:400:kworker.0 00000100:00100000:2.0:1788836670.319587:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a804724df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875730518791296:0@lo:400:kworker.0 00010000:00080000:2.0:1788836670.319598:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a804724f480 x1875730518791936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836670.319606:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a804724f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875730518791936:0@lo:400:kworker.0 00010000:00080000:0.0:1788836670.320029:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a804724dc00 x1875730518791040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788836695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788836670.320042:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788836670.320048:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788836670.320052:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788836670.320054:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9a8158dbd800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788836670.320082:0:3617:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788836670.320087:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a804724dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875730518791040:0@lo:8:kworker.0 00000004:00080000:2.0:1788836670.320184:0:22782:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:2.0:1788836670.320206:0:22782:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8048e74a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22782:1875730518792448:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788836670.320257:0:22782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836670.320281:0:22782:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8041438e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788836670.320309:0:24263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518792448 00000100:00100000:2.0:1788836670.320316:0:24263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518792448 00000100:00100000:2.0:1788836670.320353:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788836670.320361:0:24263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8048e75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22782:x1875730518792448:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788836670.321091:0:23501:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 700394627677ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788836670.321100:0:23501:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1788836670.321228:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8048e77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875730518792320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788836670.321274:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836670.321339:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518792320 00000100:00100000:0.0:1788836670.321346:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518792320 00000100:00100000:0.0:1788836670.321385:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788836670.321393:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8181bad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3621:x1875730518792320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788836670.321416:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788836670.321458:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8181bad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3621:x1875730518792320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836670.321495:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788836670.321536:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a8048e77480 x1875730518792320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836686 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836670.321552:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8048e77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875730518792320:0@lo:13:osp-pre-1-0.0 00002000:00080000:2.0:1788836670.323260:0:24263:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1788836670.323273:0:24263:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:2.0:1788836670.323280:0:24263:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:65) 00000004:00080000:1.0:1788836670.324901:0:23502:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788836670.324930:0:23502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a80455a4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23502:1875730518792704:0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1788836670.325001:0:23502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836670.325046:0:23502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8047620c00 going to sleep for 11 seconds 00000100:00080000:1.0:1788836670.325084:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788836670.325090:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788836670.325093:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788836670.325096:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:1.0:1788836670.325107:0:22781:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788836670.325196:0:22781:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 700398733799ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788836670.325203:0:22781:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788836670.327675:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518792704 00000100:00100000:1.0:1788836670.327691:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518792704 00000100:00100000:1.0:1788836670.327764:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788836670.327775:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a80455a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23502:x1875730518792704:12345-0@lo:7:osp-pre-1-1.0 00000100:00080000:1.0:1788836670.327958:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788836670.327969:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788836670.328037:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a80455a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875730518792576:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788836670.328104:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836670.328191:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518792576 00000100:00100000:1.0:1788836670.328196:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518792576 00000100:00100000:1.0:1788836670.328224:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788836670.328231:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a80455a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3619:x1875730518792576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788836670.328246:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788836670.338013:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a80455a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3619:x1875730518792576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 9769us (9895us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836670.338029:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000004:00080000:1.0:1788836670.340741:0:22735:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00080000:1.0:1788836670.342745:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a80455a6d80 x1875730518792576/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788836686 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836670.342776:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a80455a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875730518792576:0@lo:13:osp-pre-1-1.0 00002000:00080000:0.0:1788836670.344067:0:24264:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1788836670.344075:0:24264:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1788836670.344160:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a80455a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23502:x1875730518792704:12345-0@lo:7:osp-pre-1-1.0 Request processed in 16384us (19155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836670.344181:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1788836670.344315:0:23502:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a80455a4000 x1875730518792704/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788836686 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836670.344328:0:23502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a80455a4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23502:1875730518792704:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1788836670.344342:0:23502:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1788836670.344381:0:23502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a80455a4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23502:1875730518792832:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788836670.344418:0:23502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836670.344453:0:23502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8047620c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788836670.344616:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518792832 00000100:00100000:1.0:1788836670.344624:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518792832 00000100:00100000:1.0:1788836670.344730:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788836670.344740:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a80455a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23502:x1875730518792832:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1788836670.344764:0:24266:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1788836670.344799:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a80455a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23502:x1875730518792832:12345-0@lo:5:osp-pre-1-1.0 Request processed in 61us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836670.344806:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1788836670.345369:0:23502:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a80455a4000 x1875730518792832/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788836686 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788836670.345381:0:23502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a80455a4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23502:1875730518792832:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1788836670.345389:0:23502:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1788836670.345416:0:23502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a80455a4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23502:1875730518792960:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788836670.345442:0:23502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836670.345561:0:23502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8047620c00 going to sleep for 11 seconds 00002000:00010000:2.0:1788836670.346083:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788836670.346092:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c32c0f6c/0xbd163c73757163f3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.346110:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=700s v=(0 0) 00010000:00010000:2.0:1788836670.346114:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836670.346120:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c32c0f6c/0xbd163c73757163f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.346136:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c32c0f6c/0xbd163c73757163f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.346145:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c32c0f6c/0xbd163c73757163f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.346152:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c32c0f6c/0xbd163c73757163f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.346189:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788836670.346552:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518792960 00000100:00100000:0.0:1788836670.346559:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518792960 00000100:00100000:0.0:1788836670.346599:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788836670.346607:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a80455a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23502:x1875730518792960:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1788836670.346692:0:24264:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00010000:00010000:1.0:1788836670.347358:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836670.347366:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c32c0f6c/0xbd163c73757163f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836670.347377:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a817ed15c00 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:1.0:1788836670.347382:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c32c0f6c/0xbd163c73757163f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836670.347393:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c32c0f6c/0xbd163c73757163f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836670.347416:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c32c0f6c/0xbd163c73757163f3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836670.347425:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c32c0f6c/0xbd163c73757163f3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836670.347447:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836670.347449:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836670.347450:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788836670.349890:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788836670.349904:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bad2dda0/0xbd163c73757163fa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.349921:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=700s v=(0 0) 00010000:00010000:2.0:1788836670.349926:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836670.349932:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bad2dda0/0xbd163c73757163fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.349948:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bad2dda0/0xbd163c73757163fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.349959:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bad2dda0/0xbd163c73757163fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.349967:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bad2dda0/0xbd163c73757163fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.349987:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788836670.350592:0:23912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836670.350601:0:23912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bad2dda0/0xbd163c73757163fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836670.350610:0:23912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a817ed14e00 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:1.0:1788836670.350614:0:23912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bad2dda0/0xbd163c73757163fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836670.350647:0:23912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bad2dda0/0xbd163c73757163fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836670.350665:0:23912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bad2dda0/0xbd163c73757163fa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836670.350674:0:23912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bad2dda0/0xbd163c73757163fa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836670.350694:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836670.350695:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836670.350697:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788836670.351666:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788836670.351677:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f6282c1/0xbd163c7375716401 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.351692:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=700s v=(0 0) 00010000:00010000:2.0:1788836670.351704:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836670.351710:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f6282c1/0xbd163c7375716401 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.351724:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f6282c1/0xbd163c7375716401 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.351734:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f6282c1/0xbd163c7375716401 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.351742:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f6282c1/0xbd163c7375716401 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.351761:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788836670.352194:0:22743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836670.352201:0:22743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f6282c1/0xbd163c7375716401 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836670.352210:0:22743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a817ed15000 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:1.0:1788836670.352214:0:22743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f6282c1/0xbd163c7375716401 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836670.352223:0:22743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f6282c1/0xbd163c7375716401 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836670.352239:0:22743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f6282c1/0xbd163c7375716401 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836670.352257:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f6282c1/0xbd163c7375716401 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836670.352276:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836670.352278:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836670.352279:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788836670.353963:0:23490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00010000:0.0:1788836670.354996:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788836670.355008:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022c4f122/0xbd163c7375716408 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.355025:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=700s v=(0 0) 00010000:00010000:0.0:1788836670.355029:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836670.355035:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022c4f122/0xbd163c7375716408 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.355051:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022c4f122/0xbd163c7375716408 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.355062:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022c4f122/0xbd163c7375716408 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.355069:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022c4f122/0xbd163c7375716408 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.357438:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788836670.358122:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788836670.358138:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ce2a05e/0xbd163c737571640f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.358155:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=700s v=(0 0) 00010000:00010000:0.0:1788836670.358160:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836670.358166:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ce2a05e/0xbd163c737571640f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.358181:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ce2a05e/0xbd163c737571640f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.358191:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ce2a05e/0xbd163c737571640f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.358199:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ce2a05e/0xbd163c737571640f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836670.361082:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788836670.361097:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022c4f122/0xbd163c7375716408 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836670.361110:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a815158e400 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:1.0:1788836670.361115:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022c4f122/0xbd163c7375716408 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836670.361126:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022c4f122/0xbd163c7375716408 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836670.361152:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022c4f122/0xbd163c7375716408 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836670.361159:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022c4f122/0xbd163c7375716408 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836670.361186:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836670.361189:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ce2a05e/0xbd163c737571640f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836670.361213:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a815158fc00 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:1.0:1788836670.361217:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ce2a05e/0xbd163c737571640f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836670.361224:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ce2a05e/0xbd163c737571640f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836670.361235:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ce2a05e/0xbd163c737571640f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836670.361243:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836670.361245:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836670.361247:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836670.366239:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788836670.366252:0:24263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ce2a05e/0xbd163c737571640f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788836670.366797:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788836670.366805:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006199784b/0xbd163c7375716416 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.366883:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=700s v=(0 0) 00010000:00010000:0.0:1788836670.366888:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836670.366901:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006199784b/0xbd163c7375716416 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.366916:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006199784b/0xbd163c7375716416 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.366925:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006199784b/0xbd163c7375716416 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.366932:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006199784b/0xbd163c7375716416 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.366952:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788836670.367190:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788836670.367196:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006312bfd7/0xbd163c737571641d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.367204:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=700s v=(0 0) 00010000:00010000:0.0:1788836670.367207:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836670.367211:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006312bfd7/0xbd163c737571641d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.367221:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006312bfd7/0xbd163c737571641d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.367228:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006312bfd7/0xbd163c737571641d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.367248:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006312bfd7/0xbd163c737571641d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.367261:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788836670.367530:0:23912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788836670.367537:0:23912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006199784b/0xbd163c7375716416 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.367546:0:23912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a815158f200 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:2.0:1788836670.367550:0:23912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006199784b/0xbd163c7375716416 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.367559:0:23912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006199784b/0xbd163c7375716416 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.367576:0:23912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006199784b/0xbd163c7375716416 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.367594:0:23912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006199784b/0xbd163c7375716416 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.367610:0:23912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836670.367614:0:23912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006312bfd7/0xbd163c737571641d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.367620:0:23912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a815158f000 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:2.0:1788836670.367624:0:23912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006312bfd7/0xbd163c737571641d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.367632:0:23912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006312bfd7/0xbd163c737571641d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.367655:0:23912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006312bfd7/0xbd163c737571641d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.367663:0:23912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006312bfd7/0xbd163c737571641d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.367674:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836670.367676:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836670.367678:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788836670.367915:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788836670.367921:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009031874e/0xbd163c7375716424 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.367930:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=700s v=(0 0) 00010000:00010000:0.0:1788836670.367933:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836670.367937:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009031874e/0xbd163c7375716424 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.367946:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009031874e/0xbd163c7375716424 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.367954:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009031874e/0xbd163c7375716424 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.367961:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009031874e/0xbd163c7375716424 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.367981:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788836670.368267:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788836670.368274:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a887301/0xbd163c737571642b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.368287:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=700s v=(0 0) 00010000:00010000:0.0:1788836670.368303:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836670.368308:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a887301/0xbd163c737571642b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.368318:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a887301/0xbd163c737571642b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.368326:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a887301/0xbd163c737571642b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.368334:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a887301/0xbd163c737571642b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.368342:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788836670.368623:0:23912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788836670.368629:0:23912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009031874e/0xbd163c7375716424 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.368697:0:23912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a815158ea00 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:2.0:1788836670.368701:0:23912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009031874e/0xbd163c7375716424 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.368710:0:23912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009031874e/0xbd163c7375716424 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.368723:0:23912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009031874e/0xbd163c7375716424 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.368730:0:23912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009031874e/0xbd163c7375716424 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.368745:0:23912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836670.368748:0:23912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a887301/0xbd163c737571642b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.368755:0:23912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a815158f600 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:2.0:1788836670.368758:0:23912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a887301/0xbd163c737571642b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.368765:0:23912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a887301/0xbd163c737571642b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.368774:0:23912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a887301/0xbd163c737571642b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.368790:0:23912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a887301/0xbd163c737571642b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.368803:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836670.368804:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836670.368806:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788836670.368979:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788836670.368984:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da42c2c1/0xbd163c7375716432 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.368992:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=700s v=(0 0) 00010000:00010000:0.0:1788836670.368995:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788836670.369000:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da42c2c1/0xbd163c7375716432 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.369009:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da42c2c1/0xbd163c7375716432 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.369027:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da42c2c1/0xbd163c7375716432 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.369034:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da42c2c1/0xbd163c7375716432 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.369055:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788836670.369416:0:22743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836670.369423:0:22743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da42c2c1/0xbd163c7375716432 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836670.369431:0:22743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a815158e000 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:1.0:1788836670.369434:0:22743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da42c2c1/0xbd163c7375716432 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836670.369442:0:22743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da42c2c1/0xbd163c7375716432 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836670.369454:0:22743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da42c2c1/0xbd163c7375716432 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836670.369499:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da42c2c1/0xbd163c7375716432 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836670.369513:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836670.369515:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836670.369517:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836670.369523:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836670.369744:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788836670.370135:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788836670.370141:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f73ea27/0xbd163c7375716439 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.370150:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=700s v=(0 0) 00010000:00010000:2.0:1788836670.370154:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836670.370159:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f73ea27/0xbd163c7375716439 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.370168:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f73ea27/0xbd163c7375716439 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.370176:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f73ea27/0xbd163c7375716439 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.370183:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f73ea27/0xbd163c7375716439 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.370197:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788836670.371362:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788836670.371371:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f6282c1/0xbd163c7375716440 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.371384:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=700s v=(0 0) 00010000:00010000:2.0:1788836670.371388:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836670.371393:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f6282c1/0xbd163c7375716440 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.371404:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f6282c1/0xbd163c7375716440 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.371412:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f6282c1/0xbd163c7375716440 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.371420:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f6282c1/0xbd163c7375716440 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.371439:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788836670.371807:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788836670.371825:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bad2dda0/0xbd163c7375716447 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.371834:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=700s v=(0 0) 00010000:00010000:2.0:1788836670.371836:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836670.371840:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bad2dda0/0xbd163c7375716447 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.371860:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bad2dda0/0xbd163c7375716447 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.371868:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bad2dda0/0xbd163c7375716447 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.371875:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bad2dda0/0xbd163c7375716447 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.371889:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788836670.371898:0:23912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788836670.371904:0:23912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f73ea27/0xbd163c7375716439 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.371912:0:23912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a817ed14800 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:2.0:1788836670.371916:0:23912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f73ea27/0xbd163c7375716439 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.371925:0:23912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f73ea27/0xbd163c7375716439 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.371941:0:23912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f73ea27/0xbd163c7375716439 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.371948:0:23912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f73ea27/0xbd163c7375716439 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.371974:0:23912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788836670.371978:0:23912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f6282c1/0xbd163c7375716440 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.371984:0:23912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a817ed15000 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:2.0:1788836670.371987:0:23912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f6282c1/0xbd163c7375716440 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.371994:0:23912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f6282c1/0xbd163c7375716440 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.372003:0:23912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f6282c1/0xbd163c7375716440 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.372010:0:23912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f6282c1/0xbd163c7375716440 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.372020:0:23912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836670.372023:0:23912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bad2dda0/0xbd163c7375716447 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.372028:0:23912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a817ed14e00 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:2.0:1788836670.372031:0:23912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bad2dda0/0xbd163c7375716447 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.372048:0:23912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bad2dda0/0xbd163c7375716447 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.372058:0:23912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bad2dda0/0xbd163c7375716447 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.372065:0:23912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bad2dda0/0xbd163c7375716447 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.372077:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836670.372079:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836670.372080:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788836670.372440:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788836670.372446:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c32c0f6c/0xbd163c737571644e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.372454:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=700s v=(0 0) 00010000:00010000:2.0:1788836670.372457:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836670.372535:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c32c0f6c/0xbd163c737571644e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.372547:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c32c0f6c/0xbd163c737571644e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.372555:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c32c0f6c/0xbd163c737571644e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.372569:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c32c0f6c/0xbd163c737571644e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.372582:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788836670.372589:0:23912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836670.372593:0:23912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c32c0f6c/0xbd163c737571644e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.372600:0:23912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a817ed15c00 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:2.0:1788836670.372603:0:23912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c32c0f6c/0xbd163c737571644e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.372611:0:23912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c32c0f6c/0xbd163c737571644e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.372622:0:23912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c32c0f6c/0xbd163c737571644e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.372630:0:23912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c32c0f6c/0xbd163c737571644e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.372702:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836670.372704:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836670.372705:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836670.373021:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788836670.373105:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788836670.373118:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ee93d07/0xbd163c7375716455 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.373126:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=700s v=(0 0) 00010000:00010000:2.0:1788836670.373129:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836670.373133:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ee93d07/0xbd163c7375716455 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.373142:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ee93d07/0xbd163c7375716455 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.373149:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ee93d07/0xbd163c7375716455 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.373156:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ee93d07/0xbd163c7375716455 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.373168:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788836670.373175:0:23912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836670.373179:0:23912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ee93d07/0xbd163c7375716455 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.373185:0:23912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a817ed15800 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:2.0:1788836670.373188:0:23912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ee93d07/0xbd163c7375716455 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.373195:0:23912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ee93d07/0xbd163c7375716455 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.373211:0:23912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ee93d07/0xbd163c7375716455 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.373218:0:23912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ee93d07/0xbd163c7375716455 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.373230:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836670.373232:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836670.373234:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836670.373518:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788836670.374001:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788836670.374009:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a317056/0xbd163c737571645c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.374018:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=700s v=(0 0) 00010000:00010000:2.0:1788836670.374021:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836670.374025:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a317056/0xbd163c737571645c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.374034:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a317056/0xbd163c737571645c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.374042:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a317056/0xbd163c737571645c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.374048:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a317056/0xbd163c737571645c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.374073:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788836670.374318:0:22743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836670.374324:0:22743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a317056/0xbd163c737571645c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836670.374333:0:22743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a817ed15e00 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:1.0:1788836670.374337:0:22743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a317056/0xbd163c737571645c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836670.374346:0:22743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a317056/0xbd163c737571645c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836670.374359:0:22743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a317056/0xbd163c737571645c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836670.374366:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a317056/0xbd163c737571645c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836670.374381:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836670.374388:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836670.374390:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788836670.374450:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788836670.374456:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7c67dd2/0xbd163c7375716463 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.374874:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=700s v=(0 0) 00010000:00010000:2.0:1788836670.374877:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836670.374882:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7c67dd2/0xbd163c7375716463 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.374892:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7c67dd2/0xbd163c7375716463 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.374900:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7c67dd2/0xbd163c7375716463 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.374908:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7c67dd2/0xbd163c7375716463 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.374925:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788836670.375126:0:23912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836670.375132:0:23912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7c67dd2/0xbd163c7375716463 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.375140:0:23912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a817ed14600 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:0.0:1788836670.375144:0:23912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7c67dd2/0xbd163c7375716463 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.375153:0:23912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7c67dd2/0xbd163c7375716463 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.375165:0:23912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7c67dd2/0xbd163c7375716463 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.375172:0:23912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7c67dd2/0xbd163c7375716463 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.375198:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836670.375199:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836670.375201:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788836670.375442:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788836670.375448:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000122e223/0xbd163c737571646a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.375456:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=700s v=(0 0) 00010000:00010000:2.0:1788836670.375797:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836670.375802:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000122e223/0xbd163c737571646a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.376098:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000122e223/0xbd163c737571646a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.376109:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000122e223/0xbd163c737571646a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.376117:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000122e223/0xbd163c737571646a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.376139:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788836670.376954:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836670.376962:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000122e223/0xbd163c737571646a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.376970:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a817ed15200 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:0.0:1788836670.376974:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000122e223/0xbd163c737571646a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.376984:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000122e223/0xbd163c737571646a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.376999:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000122e223/0xbd163c737571646a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.377006:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000122e223/0xbd163c737571646a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.377026:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836670.377028:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836670.377029:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788836670.377137:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788836670.377143:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a479756d/0xbd163c7375716471 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.377154:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=700s v=(0 0) 00010000:00010000:2.0:1788836670.377158:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836670.377163:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a479756d/0xbd163c7375716471 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.377173:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a479756d/0xbd163c7375716471 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.377181:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a479756d/0xbd163c7375716471 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.377195:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a479756d/0xbd163c7375716471 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.377212:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788836670.377558:0:22743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836670.377565:0:22743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a479756d/0xbd163c7375716471 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836670.377572:0:22743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a817ed14400 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:1.0:1788836670.377576:0:22743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a479756d/0xbd163c7375716471 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836670.377584:0:22743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a479756d/0xbd163c7375716471 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836670.377596:0:22743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a479756d/0xbd163c7375716471 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836670.377604:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a479756d/0xbd163c7375716471 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836670.377620:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836670.377622:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836670.377624:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788836670.378648:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788836670.378657:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061fc76a1/0xbd163c7375716478 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.378669:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=700s v=(0 0) 00010000:00010000:2.0:1788836670.378673:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836670.378678:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061fc76a1/0xbd163c7375716478 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.378690:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061fc76a1/0xbd163c7375716478 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.378700:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061fc76a1/0xbd163c7375716478 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.378707:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000061fc76a1/0xbd163c7375716478 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.378727:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788836670.378738:0:23912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836670.378743:0:23912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000061fc76a1/0xbd163c7375716478 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.378757:0:23912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a817ed15a00 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:2.0:1788836670.378761:0:23912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000061fc76a1/0xbd163c7375716478 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.378769:0:23912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000061fc76a1/0xbd163c7375716478 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.378782:0:23912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000061fc76a1/0xbd163c7375716478 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.378789:0:23912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061fc76a1/0xbd163c7375716478 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.378805:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836670.378807:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836670.378808:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788836670.380938:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788836670.380950:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036821ce4/0xbd163c737571647f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.380966:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=700s v=(0 0) 00010000:00010000:2.0:1788836670.380971:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836670.380976:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036821ce4/0xbd163c737571647f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.380989:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036821ce4/0xbd163c737571647f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.381006:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036821ce4/0xbd163c737571647f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.381014:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036821ce4/0xbd163c737571647f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.381039:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788836670.381390:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788836670.381396:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000765a366d/0xbd163c7375716486 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.381405:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=700s v=(0 0) 00010000:00010000:2.0:1788836670.381409:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836670.381413:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000765a366d/0xbd163c7375716486 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.381423:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000765a366d/0xbd163c7375716486 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.381430:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000765a366d/0xbd163c7375716486 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.381436:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000765a366d/0xbd163c7375716486 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.381498:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788836670.381851:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788836670.381856:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029274576/0xbd163c737571648d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.381865:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=700s v=(0 0) 00010000:00010000:2.0:1788836670.381868:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836670.381871:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029274576/0xbd163c737571648d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.381879:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029274576/0xbd163c737571648d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.381886:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029274576/0xbd163c737571648d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.381893:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029274576/0xbd163c737571648d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.381905:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788836670.381914:0:23912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788836670.381920:0:23912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036821ce4/0xbd163c737571647f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.381927:0:23912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8048435000 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:2.0:1788836670.381937:0:23912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036821ce4/0xbd163c737571647f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.381946:0:23912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036821ce4/0xbd163c737571647f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.381962:0:23912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036821ce4/0xbd163c737571647f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.381970:0:23912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036821ce4/0xbd163c737571647f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.381990:0:23912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788836670.381994:0:23912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000765a366d/0xbd163c7375716486 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.382000:0:23912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8048434600 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:2.0:1788836670.382003:0:23912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000765a366d/0xbd163c7375716486 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.382010:0:23912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000765a366d/0xbd163c7375716486 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.382019:0:23912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000765a366d/0xbd163c7375716486 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.382026:0:23912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000765a366d/0xbd163c7375716486 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.382043:0:23912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836670.382046:0:23912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029274576/0xbd163c737571648d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.382052:0:23912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8048435c00 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:2.0:1788836670.382056:0:23912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029274576/0xbd163c737571648d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.382063:0:23912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029274576/0xbd163c737571648d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.382073:0:23912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029274576/0xbd163c737571648d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.382080:0:23912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029274576/0xbd163c737571648d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.382090:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836670.382092:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836670.382094:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788836670.382771:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788836670.382779:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5aa7e2f/0xbd163c7375716494 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.382789:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=700s v=(0 0) 00010000:00010000:2.0:1788836670.382799:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836670.382804:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5aa7e2f/0xbd163c7375716494 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.382879:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5aa7e2f/0xbd163c7375716494 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.382889:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5aa7e2f/0xbd163c7375716494 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.382896:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5aa7e2f/0xbd163c7375716494 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.382911:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788836670.382919:0:23912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836670.382923:0:23912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5aa7e2f/0xbd163c7375716494 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.382929:0:23912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8048435400 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:2.0:1788836670.382933:0:23912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5aa7e2f/0xbd163c7375716494 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.382941:0:23912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5aa7e2f/0xbd163c7375716494 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.382954:0:23912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5aa7e2f/0xbd163c7375716494 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.382973:0:23912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5aa7e2f/0xbd163c7375716494 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.382989:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836670.382991:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836670.382992:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836670.383285:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788836670.383617:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788836670.383623:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072525842/0xbd163c737571649b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.383632:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=700s v=(0 0) 00010000:00010000:2.0:1788836670.383901:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836670.383909:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072525842/0xbd163c737571649b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.383920:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072525842/0xbd163c737571649b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.383930:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072525842/0xbd163c737571649b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.383937:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000072525842/0xbd163c737571649b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.383956:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788836670.383965:0:23912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788836670.383976:0:23912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072525842/0xbd163c737571649b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.383984:0:23912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8048435800 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:2.0:1788836670.383988:0:23912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072525842/0xbd163c737571649b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.383997:0:23912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072525842/0xbd163c737571649b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.384011:0:23912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072525842/0xbd163c737571649b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.384018:0:23912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072525842/0xbd163c737571649b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.384034:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836670.384036:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836670.384037:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836670.385186:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788836670.385935:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788836670.385945:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001260773/0xbd163c73757164a2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.385961:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=700s v=(0 0) 00010000:00010000:2.0:1788836670.385965:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836670.385971:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001260773/0xbd163c73757164a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.386000:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001260773/0xbd163c73757164a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.386009:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001260773/0xbd163c73757164a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.386016:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001260773/0xbd163c73757164a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.386042:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788836670.386095:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836670.386102:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001260773/0xbd163c73757164a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836670.386111:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8048434400 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:1.0:1788836670.386122:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001260773/0xbd163c73757164a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836670.386131:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001260773/0xbd163c73757164a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836670.386149:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001260773/0xbd163c73757164a2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836670.386157:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001260773/0xbd163c73757164a2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836670.386179:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836670.386180:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836670.386182:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788836670.392771:0:25081:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:0.0:1788836670.392809:0:25081:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1788836670.392822:0:25081:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788836670.394853:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a80455a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:23502:x1875730518792960:12345-0@lo:5:osp-pre-1-1.0 Request processed in 48239us (49403us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1788836670.394866:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788836670.395615:0:23502:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1788836670.395626:0:23502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a80455a4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23502:1875730518792960:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788836670.395654:0:23502:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:0.0:1788836670.395711:0:23502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8181bac700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23502:1875730518793088:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1788836670.395757:0:23502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836670.395789:0:23502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8148a00540 going to sleep for 11 seconds 00000100:00100000:2.0:1788836670.396134:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518793088 00000100:00100000:2.0:1788836670.396142:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518793088 00000100:00100000:2.0:1788836670.396229:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788836670.396239:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8181badf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23502:x1875730518793088:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1788836670.396310:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8181badf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23502:x1875730518793088:12345-0@lo:900:osp-pre-1-1.0 Request processed in 73us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836670.396318:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788836670.396381:0:23502:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a8181bac700 x1875730518793088/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788836686 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788836670.396393:0:23502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8181bac700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23502:1875730518793088:0@lo:900:osp-pre-1-1.0 00002000:00010000:2.0:1788836670.404266:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788836670.404280:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fece2539/0xbd163c73757164a9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.404312:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=700s v=(0 0) 00010000:00010000:2.0:1788836670.404317:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836670.404323:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fece2539/0xbd163c73757164a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.404350:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fece2539/0xbd163c73757164a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.404362:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fece2539/0xbd163c73757164a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.404370:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fece2539/0xbd163c73757164a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.404636:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788836670.404850:0:23912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836670.404858:0:23912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fece2539/0xbd163c73757164a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.404867:0:23912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8048435600 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:0.0:1788836670.404871:0:23912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fece2539/0xbd163c73757164a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.404880:0:23912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fece2539/0xbd163c73757164a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.404897:0:23912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fece2539/0xbd163c73757164a9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.404904:0:23912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fece2539/0xbd163c73757164a9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.404931:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836670.404933:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836670.404935:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788836670.408005:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788836670.408020:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e6d2886/0xbd163c73757164b0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.408036:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=700s v=(0 0) 00010000:00010000:2.0:1788836670.408041:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836670.408047:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e6d2886/0xbd163c73757164b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.408061:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e6d2886/0xbd163c73757164b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.408071:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e6d2886/0xbd163c73757164b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.408097:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e6d2886/0xbd163c73757164b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.408128:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788836670.408519:0:22743:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836670.408526:0:22743:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e6d2886/0xbd163c73757164b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.408534:0:22743:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8048434200 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:0.0:1788836670.408539:0:22743:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e6d2886/0xbd163c73757164b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.408547:0:22743:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e6d2886/0xbd163c73757164b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.408566:0:22743:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e6d2886/0xbd163c73757164b0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.408573:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e6d2886/0xbd163c73757164b0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.408595:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836670.408597:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836670.408599:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788836670.408792:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788836670.408799:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1def660/0xbd163c73757164b7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.408808:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=700s v=(0 0) 00010000:00010000:2.0:1788836670.408811:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836670.408816:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1def660/0xbd163c73757164b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.408825:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1def660/0xbd163c73757164b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.408833:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1def660/0xbd163c73757164b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.408839:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1def660/0xbd163c73757164b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.408862:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788836670.409101:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836670.409107:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1def660/0xbd163c73757164b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.409127:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8048434a00 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:0.0:1788836670.409131:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1def660/0xbd163c73757164b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.409141:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1def660/0xbd163c73757164b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.409153:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1def660/0xbd163c73757164b7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.409161:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1def660/0xbd163c73757164b7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.409175:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836670.409177:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836670.409178:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788836670.409250:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788836670.409256:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ace99c4/0xbd163c73757164be lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.409271:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=700s v=(0 0) 00010000:00010000:2.0:1788836670.409274:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836670.409279:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ace99c4/0xbd163c73757164be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.409300:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ace99c4/0xbd163c73757164be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.409309:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ace99c4/0xbd163c73757164be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.409316:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ace99c4/0xbd163c73757164be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.409370:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788836670.409776:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788836670.409782:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d929e2e/0xbd163c73757164c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.409791:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=700s v=(0 0) 00010000:00010000:2.0:1788836670.409795:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836670.409799:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d929e2e/0xbd163c73757164c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.409808:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d929e2e/0xbd163c73757164c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.409826:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d929e2e/0xbd163c73757164c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.409833:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d929e2e/0xbd163c73757164c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.413284:0:23912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788836670.413308:0:23912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ace99c4/0xbd163c73757164be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.413321:0:23912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8048434c00 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:0.0:1788836670.413326:0:23912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ace99c4/0xbd163c73757164be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.413337:0:23912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ace99c4/0xbd163c73757164be lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.413378:0:23912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ace99c4/0xbd163c73757164be lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.413387:0:23912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ace99c4/0xbd163c73757164be lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.413417:0:23912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836670.413421:0:23912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d929e2e/0xbd163c73757164c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.413428:0:23912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8048434e00 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:0.0:1788836670.413431:0:23912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d929e2e/0xbd163c73757164c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.413438:0:23912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d929e2e/0xbd163c73757164c5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.413448:0:23912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d929e2e/0xbd163c73757164c5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.413455:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836670.413457:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836670.413458:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836670.413982:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788836670.413990:0:24263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d929e2e/0xbd163c73757164c5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836670.414441:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788836670.414588:0:24263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788836670.414595:0:24263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae0dce5a/0xbd163c73757164cc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.414609:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=700s v=(0 0) 00010000:00010000:2.0:1788836670.414615:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836670.414622:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae0dce5a/0xbd163c73757164cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.414744:0:24263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae0dce5a/0xbd163c73757164cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.414756:0:24263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae0dce5a/0xbd163c73757164cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.414775:0:24263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae0dce5a/0xbd163c73757164cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836670.414793:0:24263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1788836670.415055:0:24263:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:2.0:1788836670.415222:0:24263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8048e75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:22782:x1875730518792448:12345-0@lo:5:osp-pre-1-0.0 Request processed in 94858us (94960us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836670.415232:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1788836670.415322:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836670.415328:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae0dce5a/0xbd163c73757164cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.415348:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8048434000 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:0.0:1788836670.415352:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae0dce5a/0xbd163c73757164cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.415362:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae0dce5a/0xbd163c73757164cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.415378:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae0dce5a/0xbd163c73757164cc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.415386:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae0dce5a/0xbd163c73757164cc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836670.415406:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836670.415408:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836670.415410:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836670.415827:0:22782:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8048e74a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22782:1875730518792448:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788836670.415846:0:22782:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:2.0:1788836670.415953:0:22782:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8048e76300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22782:1875730518793216:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788836670.416020:0:22782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836670.416046:0:22782:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a816795ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1788836670.416063:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518793216 00000100:00100000:2.0:1788836670.416069:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518793216 00000100:00100000:2.0:1788836670.416112:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788836670.416120:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8048e74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22782:x1875730518793216:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788836670.416159:0:24266:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:2.0:1788836670.417973:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8048e74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22782:x1875730518793216:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1847us (1947us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1788836670.417985:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788836670.418051:0:22782:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8048e76300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22782:1875730518793216:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788836670.418068:0:22782:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:0.0:1788836671.142395:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836672.169157:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836672.358222:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a80455a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875730518793472:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788836672.358297:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836672.358489:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788836672.358499:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a80455a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875730518793344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788836672.358528:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836672.358562:0:24268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518793472 00000100:00100000:0.0:1788836672.358570:0:24268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518793472 00000100:00100000:1.0:1788836672.359149:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518793344 00000100:00100000:1.0:1788836672.359154:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518793344 00000100:00100000:1.0:1788836672.359182:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788836672.359189:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8181bac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875730518793344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788836672.359219:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788836672.359287:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8181bac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875730518793344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836672.359303:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1788836672.359324:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788836672.359419:0:24268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788836672.359427:0:24268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a80455a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875730518793472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788836672.359439:0:24268:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788836672.359498:0:24268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a80455a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875730518793472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (1201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836672.359504:0:24268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788836672.359823:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a80455a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875730518793472:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788836672.360097:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a80455a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875730518793344:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1788836672.475153:0:25437:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg144-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788836673.190609:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836673.383351:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788836673.383375:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a804724dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875730518793600:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788836673.383450:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836673.383522:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518793600 00000100:00100000:0.0:1788836673.383530:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518793600 00000100:00100000:0.0:1788836673.383583:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788836673.384418:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8048e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875730518793728:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788836673.384479:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836673.384573:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a804724f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875730518793600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788836673.384617:0:23498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788836673.384661:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a804724f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875730518793600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (1211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836673.384668:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788836673.384687:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518793728 00000100:00100000:0.0:1788836673.384690:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518793728 00000100:00100000:0.0:1788836673.384707:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788836673.384724:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a80455a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875730518793728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788836673.384739:0:23498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788836673.390577:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a80455a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875730518793728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 5851us (6085us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836673.390602:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788836673.390681:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a804724dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875730518793600:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788836673.399534:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8048e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875730518793728:0@lo:41:osp-pre-1-0.0 00000020:00000004:3.0:1788836673.451809:0:25489:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788836673.452077:0:25489:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788836674.223962:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788836674.534250:0:22791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:0.0:1788836674.654376:0:25539:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788836674.656100:0:25539:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788836675.011707:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836675.012525:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511319936 00000100:00100000:3.0:1788836675.012536:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511319936 00000100:00100000:3.0:1788836675.012600:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 119 00000100:00100000:3.0:1788836675.012608:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81597da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2407:x1875730511319936:12345-192.168.201.44@tcp:250:mount.lustre.0 00010000:00080000:3.0:1788836675.012636:0:22748:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 2ef4c47b-fc99-4862-96ec-0565fed75f8d@192.168.201.44@tcp t0 exp 0000000000000000 cur 705 last 0 00000020:00000080:3.0:1788836675.012663:0:22748:0:(genops.c:1385:class_connect()) connect: client 2ef4c47b-fc99-4862-96ec-0565fed75f8d, cookie 0xbd163c73757164d3 00000100:00080000:3.0:1788836675.013069:0:22748:0:(import.c:65:import_set_state_nolock()) ffff9a804765a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788836675.013144:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81597da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ef4c47b-fc99-4862-96ec-0565fed75f8d+5:2407:x1875730511319936:12345-192.168.201.44@tcp:250:mount.lustre.0 Request processed in 534us (1462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836675.013152:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 119 00000100:00100000:1.0:1788836675.015758:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836675.015875:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511320064 00000100:00100000:2.0:1788836675.015884:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511320064 00000100:00100000:2.0:1788836675.015980:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 120 00000100:00100000:2.0:1788836675.016001:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81597dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ef4c47b-fc99-4862-96ec-0565fed75f8d+5:18120:x1875730511320064:12345-192.168.201.44@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788836675.016019:0:22749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836675.016037:0:22749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8048435a00/0xbd163c73757164da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4f244a55304e498 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836675.016066:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8048435a00/0xbd163c73757164da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e498 expref: 6 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836675.016078:0:22749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8048435a00/0xbd163c73757164da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e498 expref: 6 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836675.016087:0:22749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8048435a00, rc 0) 00000100:00100000:2.0:1788836675.016152:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81597dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ef4c47b-fc99-4862-96ec-0565fed75f8d+6:18120:x1875730511320064:12345-192.168.201.44@tcp:101:mount.lustre.0 Request processed in 152us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836675.016159:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 120 00000100:00100000:1.0:1788836675.039024:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836675.039144:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511320192 00000100:00100000:3.0:1788836675.039154:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511320192 00000100:00100000:3.0:1788836675.039221:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 121 00000100:00100000:3.0:1788836675.039233:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81597d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ef4c47b-fc99-4862-96ec-0565fed75f8d+6:18120:x1875730511320192:12345-192.168.201.44@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788836675.039383:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81597d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ef4c47b-fc99-4862-96ec-0565fed75f8d+6:18120:x1875730511320192:12345-192.168.201.44@tcp:501:mount.lustre.0 Request processed in 152us (369us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788836675.039392:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 121 00000100:00100000:3.0:1788836675.045056:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836675.045416:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511320320 00000100:00100000:2.0:1788836675.045428:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511320320 00000100:00100000:3.0:1788836675.045822:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 122 00000100:00100000:3.0:1788836675.045835:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8181ba9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ef4c47b-fc99-4862-96ec-0565fed75f8d+6:18120:x1875730511320320:12345-192.168.201.44@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788836675.045851:0:22748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836675.045869:0:22748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a80462e6c00/0xbd163c73757164e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4f244a55304e49f expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836675.045913:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a80462e6c00/0xbd163c73757164e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e49f expref: 7 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836675.045926:0:22748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a80462e6c00/0xbd163c73757164e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e49f expref: 7 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836675.045936:0:22748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a80462e6c00, rc 0) 00000100:00100000:3.0:1788836675.045999:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8181ba9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ef4c47b-fc99-4862-96ec-0565fed75f8d+7:18120:x1875730511320320:12345-192.168.201.44@tcp:101:mount.lustre.0 Request processed in 168us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836675.046006:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 122 00000100:00100000:2.0:1788836675.052759:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836675.068706:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511320448 00000100:00100000:1.0:1788836675.068724:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511320448 00000100:00100000:1.0:1788836675.068834:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 123 00000100:00100000:1.0:1788836675.068845:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8181bab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ef4c47b-fc99-4862-96ec-0565fed75f8d+7:18120:x1875730511320448:12345-192.168.201.44@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788836675.069019:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8181bab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ef4c47b-fc99-4862-96ec-0565fed75f8d+8:18120:x1875730511320448:12345-192.168.201.44@tcp:501:mount.lustre.0 Request processed in 174us (16269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836675.069028:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 123 00000100:00100000:1.0:1788836675.082169:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836675.083412:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511320576 00000100:00100000:3.0:1788836675.083426:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511320576 00000100:00100000:3.0:1788836675.083524:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 124 00000100:00100000:3.0:1788836675.083535:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8181ba8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ef4c47b-fc99-4862-96ec-0565fed75f8d+8:18120:x1875730511320576:12345-192.168.201.44@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788836675.084612:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8181ba8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ef4c47b-fc99-4862-96ec-0565fed75f8d+8:18120:x1875730511320576:12345-192.168.201.44@tcp:503:mount.lustre.0 Request processed in 1074us (2447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836675.084623:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 124 00000100:00100000:2.0:1788836675.094798:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836675.095107:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511320704 00000100:00100000:3.0:1788836675.095121:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511320704 00000100:00100000:3.0:1788836675.095185:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 125 00000100:00100000:3.0:1788836675.095195:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8181bab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ef4c47b-fc99-4862-96ec-0565fed75f8d+8:18139:x1875730511320704:12345-192.168.201.44@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788836675.095396:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8181bab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ef4c47b-fc99-4862-96ec-0565fed75f8d+8:18139:x1875730511320704:12345-192.168.201.44@tcp:502:llog_process_th.0 Request processed in 194us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836675.095405:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 125 00000100:00100000:2.0:1788836675.115332:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836675.115785:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511320832 00000100:00100000:1.0:1788836675.115796:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511320832 00000100:00100000:1.0:1788836675.115854:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 126 00000100:00100000:1.0:1788836675.115864:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8181baa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ef4c47b-fc99-4862-96ec-0565fed75f8d+8:18139:x1875730511320832:12345-192.168.201.44@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788836675.116029:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8181baa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ef4c47b-fc99-4862-96ec-0565fed75f8d+8:18139:x1875730511320832:12345-192.168.201.44@tcp:502:llog_process_th.0 Request processed in 165us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836675.116038:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 126 00000100:00100000:0.0:1788836675.125526:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836675.126792:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511320960 00000100:00100000:1.0:1788836675.126805:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511320960 00000100:00100000:1.0:1788836675.126866:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 127 00000100:00100000:1.0:1788836675.126876:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8181ba9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ef4c47b-fc99-4862-96ec-0565fed75f8d+8:18139:x1875730511320960:12345-192.168.201.44@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788836675.130409:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8181ba9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ef4c47b-fc99-4862-96ec-0565fed75f8d+8:18139:x1875730511320960:12345-192.168.201.44@tcp:502:llog_process_th.0 Request processed in 3520us (4879us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836675.130425:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 127 00000100:00100000:2.0:1788836675.136644:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836675.136779:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511321088 00000100:00100000:3.0:1788836675.136804:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511321088 00000100:00100000:3.0:1788836675.136867:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 128 00000100:00100000:3.0:1788836675.136878:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f3e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ef4c47b-fc99-4862-96ec-0565fed75f8d+8:18120:x1875730511321088:12345-192.168.201.44@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788836675.136894:0:22748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836675.136912:0:22748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a80462e6400/0xbd163c73757164e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4f244a55304e4d0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836675.136945:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a80462e6400/0xbd163c73757164e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e4d0 expref: 9 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836675.136957:0:22748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a80462e6400/0xbd163c73757164e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e4d0 expref: 9 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836675.136967:0:22748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a80462e6400, rc 0) 00000100:00100000:3.0:1788836675.137042:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f3e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ef4c47b-fc99-4862-96ec-0565fed75f8d+9:18120:x1875730511321088:12345-192.168.201.44@tcp:101:mount.lustre.0 Request processed in 166us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836675.137050:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 128 00000100:00100000:2.0:1788836675.144134:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836675.144366:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511321216 00000100:00100000:3.0:1788836675.144378:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511321216 00000100:00100000:3.0:1788836675.144449:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 129 00000100:00100000:3.0:1788836675.144498:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814700f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ef4c47b-fc99-4862-96ec-0565fed75f8d+9:18120:x1875730511321216:12345-192.168.201.44@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788836675.144526:0:22749:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788836675.144552:0:22749:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788836675.144568:0:22749:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788836675.144571:0:22749:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788836675.144575:0:22749:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788836675.144577:0:22749:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:3.0:1788836675.146727:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814700f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ef4c47b-fc99-4862-96ec-0565fed75f8d+9:18120:x1875730511321216:12345-192.168.201.44@tcp:256:mount.lustre.0 Request processed in 2260us (2593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836675.146752:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 129 00000100:00100000:0.0:1788836675.167334:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836675.167514:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511321344 00000100:00100000:1.0:1788836675.167526:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511321344 00000100:00100000:1.0:1788836675.167592:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 130 00000100:00100000:1.0:1788836675.167604:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814700cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ef4c47b-fc99-4862-96ec-0565fed75f8d+9:18120:x1875730511321344:12345-192.168.201.44@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788836675.167625:0:22750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836675.167644:0:22750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a817f41be00/0xbd163c73757164ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4f244a55304e4d7 expref: -99 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836675.167676:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a817f41be00/0xbd163c73757164ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e4d7 expref: 10 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836675.167688:0:22750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a817f41be00/0xbd163c73757164ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e4d7 expref: 10 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836675.167807:0:22750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a817f41be00, rc 0) 00000100:00100000:1.0:1788836675.167860:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814700cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ef4c47b-fc99-4862-96ec-0565fed75f8d+10:18120:x1875730511321344:12345-192.168.201.44@tcp:101:mount.lustre.0 Request processed in 258us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836675.167868:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 130 00000100:00100000:2.0:1788836675.170571:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836675.170767:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511321472 00000100:00100000:3.0:1788836675.170778:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511321472 00000100:00100000:3.0:1788836675.170841:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 131 00000100:00100000:3.0:1788836675.170853:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814700ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ef4c47b-fc99-4862-96ec-0565fed75f8d+10:18120:x1875730511321472:12345-192.168.201.44@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788836675.171012:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814700ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ef4c47b-fc99-4862-96ec-0565fed75f8d+10:18120:x1875730511321472:12345-192.168.201.44@tcp:501:mount.lustre.0 Request processed in 160us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836675.171020:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 131 00000100:00100000:0.0:1788836675.179070:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836675.179703:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511321600 00000100:00100000:2.0:1788836675.179714:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511321600 00000100:00100000:2.0:1788836675.179779:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 132 00000100:00100000:2.0:1788836675.179790:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814700f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ef4c47b-fc99-4862-96ec-0565fed75f8d+10:18120:x1875730511321600:12345-192.168.201.44@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788836675.179975:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814700f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ef4c47b-fc99-4862-96ec-0565fed75f8d+10:18120:x1875730511321600:12345-192.168.201.44@tcp:503:mount.lustre.0 Request processed in 185us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836675.179994:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 132 00000100:00100000:0.0:1788836675.184962:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836675.185787:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511321728 00000100:00100000:3.0:1788836675.185797:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511321728 00000100:00100000:3.0:1788836675.185860:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 133 00000100:00100000:3.0:1788836675.185871:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814700c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ef4c47b-fc99-4862-96ec-0565fed75f8d+10:18145:x1875730511321728:12345-192.168.201.44@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788836675.186025:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814700c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ef4c47b-fc99-4862-96ec-0565fed75f8d+10:18145:x1875730511321728:12345-192.168.201.44@tcp:502:llog_process_th.0 Request processed in 156us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836675.186033:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 133 00000100:00100000:3.0:1788836675.207248:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836675.208890:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511321856 00000100:00100000:1.0:1788836675.208905:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511321856 00000100:00100000:1.0:1788836675.208989:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 134 00000100:00100000:1.0:1788836675.209000:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814700e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ef4c47b-fc99-4862-96ec-0565fed75f8d+10:18145:x1875730511321856:12345-192.168.201.44@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788836675.209229:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814700e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ef4c47b-fc99-4862-96ec-0565fed75f8d+10:18145:x1875730511321856:12345-192.168.201.44@tcp:502:llog_process_th.0 Request processed in 231us (1996us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836675.209243:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 134 00010000:00010000:1.0:1788836675.240819:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836675.244517:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:0.0:1788836675.244567:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836675.250342:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511321984 00000100:00100000:1.0:1788836675.250358:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511321984 00000100:00100000:1.0:1788836675.250435:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511322240 00000100:00100000:1.0:1788836675.250439:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511322240 00000100:00100000:1.0:1788836675.250488:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 7 00000100:00100000:1.0:1788836675.250497:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a804724dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2407:x1875730511321984:12345-192.168.201.44@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788836675.250532:0:22754:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from f990379c-347e-4ded-be44-9f2a58ff1508@192.168.201.44@tcp t0 exp 0000000000000000 cur 705 last 0 00000020:00000080:1.0:1788836675.250590:0:22754:0:(genops.c:1385:class_connect()) connect: client f990379c-347e-4ded-be44-9f2a58ff1508, cookie 0xbd163c73757164f6 00000004:00100000:1.0:1788836675.250618:0:22754:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:1.0:1788836675.250854:0:22754:0:(import.c:65:import_set_state_nolock()) ffff9a8047dd0800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788836675.250930:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a804724dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f990379c-347e-4ded-be44-9f2a58ff1508+6:2407:x1875730511321984:12345-192.168.201.44@tcp:38:mount.lustre.0 Request processed in 432us (6424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836675.250935:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 8 00000100:00100000:0.0:1788836675.250941:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a804724df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2407:x1875730511322240:12345-192.168.201.44@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788836675.250959:0:22756:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from f990379c-347e-4ded-be44-9f2a58ff1508@192.168.201.44@tcp t0 exp 0000000000000000 cur 705 last 0 00000020:00000080:0.0:1788836675.250990:0:22756:0:(genops.c:1385:class_connect()) connect: client f990379c-347e-4ded-be44-9f2a58ff1508, cookie 0xbd163c73757164fd 00000004:00100000:0.0:1788836675.251016:0:22756:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:0.0:1788836675.251156:0:22756:0:(import.c:65:import_set_state_nolock()) ffff9a81735e2800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788836675.251182:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a804724df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f990379c-347e-4ded-be44-9f2a58ff1508+6:2407:x1875730511322240:12345-192.168.201.44@tcp:38:mount.lustre.0 Request processed in 239us (6614us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836675.252636:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 7 00000100:00100000:1.0:1788836675.260064:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836675.260121:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836675.260167:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836675.260220:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511322112 00000100:00100000:1.0:1788836675.260231:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511322112 00000100:00080000:1.0:1788836675.260261:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788836675.260309:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511322496 00000100:00100000:1.0:1788836675.260312:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511322496 00000100:00100000:1.0:1788836675.260337:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511322368 00000100:00100000:1.0:1788836675.260340:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511322368 00000100:00080000:1.0:1788836675.260352:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788836675.260521:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 9 00000100:00100000:1.0:1788836675.260533:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a80455a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f990379c-347e-4ded-be44-9f2a58ff1508+7:0:x1875730511322112:12345-192.168.201.44@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788836675.260571:0:22754:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788836675.260659:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a80455a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f990379c-347e-4ded-be44-9f2a58ff1508+7:0:x1875730511322112:12345-192.168.201.44@tcp:41:mount.lustre.0 Request processed in 128us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836675.260668:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 9 00000100:00100000:1.0:1788836675.260686:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 10 00000100:00100000:1.0:1788836675.260693:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a80455a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f990379c-347e-4ded-be44-9f2a58ff1508+6:18120:x1875730511322496:12345-192.168.201.44@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788836675.260705:0:22754:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788836675.260725:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a80455a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f990379c-347e-4ded-be44-9f2a58ff1508+6:18120:x1875730511322496:12345-192.168.201.44@tcp:41:mount.lustre.0 Request processed in 33us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836675.260732:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 10 00000100:00100000:1.0:1788836675.260745:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 11 00000100:00100000:1.0:1788836675.260751:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a80455a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f990379c-347e-4ded-be44-9f2a58ff1508+7:0:x1875730511322368:12345-192.168.201.44@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788836675.260781:0:22754:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788836675.260819:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a80455a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f990379c-347e-4ded-be44-9f2a58ff1508+7:0:x1875730511322368:12345-192.168.201.44@tcp:41:mount.lustre.0 Request processed in 67us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836675.260825:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 11 00000100:00100000:0.0:1788836675.264498:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 8 00000100:00100000:1.0:1788836675.267711:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836675.267835:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511322624 00000100:00100000:2.0:1788836675.267846:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511322624 00000100:00100000:2.0:1788836675.267911:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 12 00000100:00100000:2.0:1788836675.267922:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a80455a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f990379c-347e-4ded-be44-9f2a58ff1508+6:18120:x1875730511322624:12345-192.168.201.44@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788836675.268011:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a80455a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f990379c-347e-4ded-be44-9f2a58ff1508+6:18120:x1875730511322624:12345-192.168.201.44@tcp:40:mount.lustre.0 Request processed in 89us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836675.268018:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 12 00000100:00100000:1.0:1788836675.272934:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836675.272996:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836675.273043:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836675.273142:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511323008 00000100:00100000:2.0:1788836675.273152:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511323008 00000100:00100000:2.0:1788836675.273216:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 3 00000100:00100000:2.0:1788836675.273228:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a80455a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f990379c-347e-4ded-be44-9f2a58ff1508+6:18120:x1875730511323008:12345-192.168.201.44@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788836675.273319:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a80455a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f990379c-347e-4ded-be44-9f2a58ff1508+6:18120:x1875730511323008:12345-192.168.201.44@tcp:900:mount.lustre.0 Request processed in 93us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836675.273328:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 3 00000100:00100000:0.0:1788836675.281541:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511322752 00000100:00100000:0.0:1788836675.282114:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511322752 00000100:00100000:1.0:1788836675.284450:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511322880 00000100:00100000:1.0:1788836675.284488:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511322880 00000100:00100000:1.0:1788836675.284526:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 21 00000100:00100000:1.0:1788836675.284535:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a816bd74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2407:x1875730511322752:12345-192.168.201.44@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788836675.284572:0:24264:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from f990379c-347e-4ded-be44-9f2a58ff1508@192.168.201.44@tcp t0 exp 0000000000000000 cur 705 last 0 00000020:00000080:1.0:1788836675.284609:0:24264:0:(genops.c:1385:class_connect()) connect: client f990379c-347e-4ded-be44-9f2a58ff1508, cookie 0xbd163c7375716504 00002000:00100000:1.0:1788836675.284621:0:24264:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f990379c-347e-4ded-be44-9f2a58ff1508/ffff9a8047dd5000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788836675.284639:0:24264:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:1.0:1788836675.285028:0:24264:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788836675.285076:0:24264:0:(import.c:65:import_set_state_nolock()) ffff9a8047dd5800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788836675.285149:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a816bd74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f990379c-347e-4ded-be44-9f2a58ff1508+6:2407:x1875730511322752:12345-192.168.201.44@tcp:8:mount.lustre.0 Request processed in 613us (12151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836675.285157:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 21 00000100:00100000:1.0:1788836675.285176:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 22 00000100:00100000:1.0:1788836675.285181:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166d8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2407:x1875730511322880:12345-192.168.201.44@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788836675.285197:0:24264:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from f990379c-347e-4ded-be44-9f2a58ff1508@192.168.201.44@tcp t0 exp 0000000000000000 cur 705 last 0 00000020:00000080:1.0:1788836675.285226:0:24264:0:(genops.c:1385:class_connect()) connect: client f990379c-347e-4ded-be44-9f2a58ff1508, cookie 0xbd163c737571650b 00002000:00100000:1.0:1788836675.285233:0:24264:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f990379c-347e-4ded-be44-9f2a58ff1508/ffff9a8047dd3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788836675.285245:0:24264:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:1.0:1788836675.285577:0:24264:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788836675.285596:0:24264:0:(import.c:65:import_set_state_nolock()) ffff9a815f7aa800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788836675.285623:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166d8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f990379c-347e-4ded-be44-9f2a58ff1508+6:2407:x1875730511322880:12345-192.168.201.44@tcp:8:mount.lustre.0 Request processed in 440us (12580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836675.285630:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 22 00000100:00100000:1.0:1788836675.288058:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836675.292489:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511323136 00000100:00100000:2.0:1788836675.292508:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511323136 00000100:00100000:2.0:1788836675.292626:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 0 00000100:00100000:2.0:1788836675.292637:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166d89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f990379c-347e-4ded-be44-9f2a58ff1508+6:18120:x1875730511323136:12345-192.168.201.44@tcp:33:mount.lustre.0 00000004:00080000:3.0:1788836675.295411:0:22757:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2673us 00000004:00200000:1.0:1788836675.312509:0:22757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788836675.312640:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166d89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f990379c-347e-4ded-be44-9f2a58ff1508+6:18120:x1875730511323136:12345-192.168.201.44@tcp:33:mount.lustre.0 Request processed in 19999us (24584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836675.312656:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 0 00000100:00100000:3.0:1788836675.429848:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f50d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875730518794112:0@lo:400:kworker.0 00000100:00100000:3.0:1788836675.429921:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836675.429980:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f50d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875730518794624:0@lo:400:kworker.0 00000100:00100000:3.0:1788836675.430004:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836675.430023:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f50ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1875730518795136:0@lo:400:kworker.0 00000100:00100000:3.0:1788836675.430046:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836675.430085:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788836675.430092:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f50fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875730518793984:0@lo:400:kworker.0 00000100:00100000:3.0:1788836675.430117:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836675.430140:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f50c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875730518794496:0@lo:400:kworker.0 00000100:00100000:3.0:1788836675.430161:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836675.430175:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f50c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1875730518795008:0@lo:400:kworker.0 00000100:00100000:3.0:1788836675.430193:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836675.430234:0:24288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518795136 00000100:00100000:3.0:1788836675.430241:0:24288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518795136 00000100:00100000:3.0:1788836675.430295:0:24288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518795008 00000100:00100000:3.0:1788836675.430298:0:24288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518795008 00000100:00100000:3.0:1788836675.430323:0:24288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788836675.430332:0:24288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166e97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875730518795136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836675.430408:0:24288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166e97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875730518795136:12345-0@lo:400:kworker.0 Request processed in 77us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836675.430417:0:24288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788836675.430435:0:24288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788836675.430442:0:24288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166e95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875730518795008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836675.430498:0:24288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166e95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875730518795008:12345-0@lo:400:kworker.0 Request processed in 57us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836675.430504:0:24288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788836675.430525:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518793984 00000100:00100000:3.0:1788836675.430528:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518793984 00000100:00100000:3.0:1788836675.430551:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518794496 00000100:00100000:3.0:1788836675.430554:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518794496 00000100:00100000:3.0:1788836675.430568:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788836675.430573:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166e95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875730518793984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836675.430615:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166e95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875730518793984:12345-0@lo:400:kworker.0 Request processed in 41us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836675.430622:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788836675.430635:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788836675.430641:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166e97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875730518794496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836675.430665:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166e97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875730518794496:12345-0@lo:400:kworker.0 Request processed in 25us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836675.430671:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788836675.430689:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518794112 00000100:00100000:3.0:1788836675.430693:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518794112 00000100:00100000:3.0:1788836675.430715:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518794624 00000100:00100000:3.0:1788836675.430718:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518794624 00000100:00100000:3.0:1788836675.430735:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788836675.430742:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166e96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875730518794112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836675.430788:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166e96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875730518794112:12345-0@lo:400:kworker.0 Request processed in 46us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836675.430794:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788836675.430806:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788836675.430812:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166e95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875730518794624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836675.430839:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166e95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875730518794624:12345-0@lo:400:kworker.0 Request processed in 27us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836675.430845:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1788836675.430862:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788836675.430867:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788836675.430869:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788836675.430899:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f50fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875730518793984:0@lo:400:kworker.0 00000100:00100000:3.0:1788836675.430921:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f50c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875730518794496:0@lo:400:kworker.0 00010000:00080000:3.0:1788836675.430933:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a817f50c000 x1875730518795008/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836691 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836675.430943:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f50c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1875730518795008:0@lo:400:kworker.0 00000100:00100000:3.0:1788836675.430953:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f50d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875730518794112:0@lo:400:kworker.0 00000100:00100000:3.0:1788836675.430962:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f50d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875730518794624:0@lo:400:kworker.0 00010000:00080000:3.0:1788836675.430972:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a817f50ce00 x1875730518795136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836691 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836675.430981:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f50ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1875730518795136:0@lo:400:kworker.0 00000100:00100000:1.0:1788836675.433256:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f50c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875730518794240:0@lo:400:kworker.0 00000100:00100000:1.0:1788836675.433331:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836675.433406:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f50e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875730518794752:0@lo:400:kworker.0 00000100:00100000:1.0:1788836675.433430:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836675.433452:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f50ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875730518795264:0@lo:400:kworker.0 00000100:00100000:1.0:1788836675.433496:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836675.433526:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1788836675.433533:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f50ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d9f3bec-9812-4f3e-be22-5440158bfa78:3618:1875730518793856:0@lo:400:kworker.0 00000100:00100000:1.0:1788836675.433576:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836675.433607:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f50ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875730518794368:0@lo:400:kworker.0 00000100:00100000:1.0:1788836675.433629:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836675.433650:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f50f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875730518794880:0@lo:400:kworker.0 00000100:00100000:1.0:1788836675.433669:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836675.433686:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8166e95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875730518795392:0@lo:400:kworker.0 00000100:00100000:1.0:1788836675.433706:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836675.433731:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518795264 00000100:00100000:1.0:1788836675.433938:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518795264 00000100:00100000:1.0:1788836675.433989:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518794368 00000100:00100000:1.0:1788836675.433992:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518794368 00000100:00100000:1.0:1788836675.434005:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518794880 00000100:00100000:1.0:1788836675.434007:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518794880 00000100:00100000:1.0:1788836675.434032:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518795392 00000100:00100000:1.0:1788836675.434035:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518795392 00000100:00100000:1.0:1788836675.434051:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788836675.434059:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8172d96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875730518795264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836675.434119:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8172d96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875730518795264:12345-0@lo:400:kworker.0 Request processed in 60us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836675.434126:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788836675.434144:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788836675.434150:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8172d95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875730518794368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836675.434180:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8172d95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875730518794368:12345-0@lo:400:kworker.0 Request processed in 30us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836675.434185:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788836675.434196:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788836675.434211:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8172d94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875730518794880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836675.434241:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8172d94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875730518794880:12345-0@lo:400:kworker.0 Request processed in 40us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836675.434247:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788836675.434260:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788836675.434266:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8172d97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875730518795392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788836675.434294:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8172d97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875730518795392:12345-0@lo:400:kworker.0 Request processed in 29us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836675.434300:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788836675.434319:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518794240 00000100:00100000:1.0:1788836675.434322:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518794240 00000100:00100000:1.0:1788836675.434339:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518794752 00000100:00100000:1.0:1788836675.434341:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518794752 00000100:00100000:1.0:1788836675.434354:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788836675.434366:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8172d95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3618:x1875730518794240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836675.434561:0:24573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788836675.434571:0:24573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8172d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1875730518794752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836675.434606:0:24573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8172d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1875730518794752:12345-0@lo:400:kworker.0 Request processed in 38us (1175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836675.434613:0:24573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788836675.434684:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518793856 00000100:00100000:2.0:1788836675.434687:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518793856 00000100:00100000:2.0:1788836675.434714:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788836675.434720:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814700e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+24:3618:x1875730518793856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836675.434763:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814700e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+24:3618:x1875730518793856:12345-0@lo:400:kworker.0 Request processed in 43us (1186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836675.434769:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788836675.434793:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788836675.434803:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8048e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875730518795520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788836675.434828:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836675.434899:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f50ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d9f3bec-9812-4f3e-be22-5440158bfa78:3618:1875730518793856:0@lo:400:kworker.0 00010000:00080000:2.0:1788836675.434912:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a817f50ea00 x1875730518794368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836691 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836675.434924:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f50ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875730518794368:0@lo:400:kworker.0 00010000:00080000:2.0:1788836675.434933:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a817f50f800 x1875730518794880/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836691 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836675.434942:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f50f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875730518794880:0@lo:400:kworker.0 00010000:00080000:2.0:1788836675.434951:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a8166e95880 x1875730518795392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836691 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836675.434958:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8166e95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875730518795392:0@lo:400:kworker.0 00000100:00100000:2.0:1788836675.434967:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f50e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875730518794752:0@lo:400:kworker.0 00010000:00080000:2.0:1788836675.434974:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a817f50ca80 x1875730518795264/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836691 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836675.434994:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f50ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875730518795264:0@lo:400:kworker.0 00000100:00080000:3.0:1788836675.435143:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788836675.435148:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788836675.435150:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788836675.435595:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788836675.435606:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a804724f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875730518795648:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788836675.435637:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836675.435667:0:24268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518795520 00000100:00100000:0.0:1788836675.435671:0:24268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518795520 00000100:00100000:0.0:1788836675.435694:0:24268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518795648 00000100:00100000:0.0:1788836675.435696:0:24268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518795648 00000100:00100000:0.0:1788836675.435708:0:24268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788836675.435714:0:24268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8048e74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3621:x1875730518795520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788836675.435729:0:24268:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788836675.435882:0:24268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8048e74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3621:x1875730518795520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 167us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836675.435888:0:24268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788836675.435902:0:24268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788836675.435907:0:24268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a804724e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875730518795648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788836675.435917:0:24268:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788836675.435979:0:24268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a804724e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875730518795648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836675.435985:0:24268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788836675.436020:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a804724f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875730518795648:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788836675.437616:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8172d95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3618:x1875730518794240:12345-0@lo:400:kworker.0 Request processed in 3243us (4278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836675.437629:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788836675.437838:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8048e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875730518795520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788836675.439035:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f50c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875730518794240:0@lo:400:kworker.0 00000100:00100000:1.0:1788836675.527676:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836675.527804:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511323264 00000100:00100000:3.0:1788836675.527815:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511323264 00000100:00100000:3.0:1788836675.527918:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 13 00000100:00100000:3.0:1788836675.527930:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8172d95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f990379c-347e-4ded-be44-9f2a58ff1508+6:18168:x1875730511323264:12345-192.168.201.44@tcp:101:mkdir.0 00010000:00010000:3.0:1788836675.527952:0:22755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836675.527977:0:22755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e6200/0xbd163c7375716512 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4f244a55304e508 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836675.528053:0:22755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7600/0xbd163c7375716519 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836675.528066:0:22755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7600/0xbd163c7375716519 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836675.528098:0:22755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7600/0xbd163c7375716519 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836675.528151:0:22755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788836675.528155:0:22755:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788836675.528190:0:22755:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7600/0xbd163c7375716519 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836675.528228:0:22755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e6200/0xbd163c7375716512 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e508 expref: 8 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836675.528246:0:22755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7600/0xbd163c7375716519 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e508 expref: 7 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836675.528254:0:22755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8164675c00) 00010000:00010000:3.0:1788836675.528257:0:22755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788836675.528260:0:22755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a80462e7600, rc 0) 00000100:00100000:3.0:1788836675.528320:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8172d95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f990379c-347e-4ded-be44-9f2a58ff1508+7:18168:x1875730511323264:12345-192.168.201.44@tcp:101:mkdir.0 Request processed in 393us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836675.528327:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 13 00000001:00100000:0.0:1788836675.946842:0:25081:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f990379c-347e-4ded-be44-9f2a58ff1508 00000001:00080000:0.0:1788836675.946861:0:25081:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00010000:00010000:0.0:1788836676.261925:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836677.285936:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836677.478185:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8172d96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875730518795776:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788836677.478270:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836677.479108:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8166e96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875730518795904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788836677.479151:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836677.479304:0:24268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518795776 00000100:00100000:1.0:1788836677.479312:0:24268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518795776 00000100:00100000:1.0:1788836677.479372:0:24268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518795904 00000100:00100000:1.0:1788836677.479376:0:24268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518795904 00000100:00100000:1.0:1788836677.479392:0:24268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788836677.479401:0:24268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a804724f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875730518795776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788836677.479433:0:24268:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788836677.479545:0:24268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a804724f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875730518795776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 143us (1274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836677.479552:0:24268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788836677.479749:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8172d96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875730518795776:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788836677.480039:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788836677.480076:0:24268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788836677.480087:0:24268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8048e74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875730518795904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788836677.480102:0:24268:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788836677.480708:0:24268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8048e74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875730518795904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 614us (1547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836677.480717:0:24268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788836677.494673:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8166e96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875730518795904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788836678.055732:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836678.055883:0:24288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511323392 00000100:00100000:2.0:1788836678.055894:0:24288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511323392 00000100:00080000:3.0:1788836678.055942:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788836678.055968:0:24288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 14 00000100:00100000:2.0:1788836678.055979:0:24288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8172d94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f990379c-347e-4ded-be44-9f2a58ff1508+7:18221:x1875730511323392:12345-192.168.201.44@tcp:41:lfs.0 00000004:00000024:2.0:1788836678.056021:0:24288:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788836678.056112:0:24288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8172d94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f990379c-347e-4ded-be44-9f2a58ff1508+7:18221:x1875730511323392:12345-192.168.201.44@tcp:41:lfs.0 Request processed in 135us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836678.056120:0:24288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 14 00000100:00100000:3.0:1788836678.059514:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836678.061151:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511323520 00000100:00100000:2.0:1788836678.061177:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511323520 00000100:00100000:2.0:1788836678.061268:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 15 00000100:00100000:2.0:1788836678.061282:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166e97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f990379c-347e-4ded-be44-9f2a58ff1508+6:18221:x1875730511323520:12345-192.168.201.44@tcp:41:lfs.0 00000004:00000024:2.0:1788836678.061328:0:22754:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788836678.061434:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166e97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f990379c-347e-4ded-be44-9f2a58ff1508+6:18221:x1875730511323520:12345-192.168.201.44@tcp:41:lfs.0 Request processed in 156us (1930us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836678.061442:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 15 00000100:00080000:3.0:1788836678.061599:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788836678.066259:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:0.0:1788836678.066801:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511323648 00000100:00100000:0.0:1788836678.066813:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511323648 00000100:00100000:0.0:1788836678.066888:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 15 00000100:00100000:0.0:1788836678.066899:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166e97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f990379c-347e-4ded-be44-9f2a58ff1508+6:18221:x1875730511323648:12345-192.168.201.44@tcp:13:lfs.0 00002000:00000024:0.0:1788836678.066925:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788836678.067024:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166e97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f990379c-347e-4ded-be44-9f2a58ff1508+6:18221:x1875730511323648:12345-192.168.201.44@tcp:13:lfs.0 Request processed in 126us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836678.067048:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 15 00000100:00080000:3.0:1788836678.067854:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788836678.072588:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836678.073169:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511323776 00000100:00100000:3.0:1788836678.073180:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511323776 00000100:00100000:3.0:1788836678.073263:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 16 00000100:00100000:3.0:1788836678.073275:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a804724ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f990379c-347e-4ded-be44-9f2a58ff1508+5:18221:x1875730511323776:12345-192.168.201.44@tcp:13:lfs.0 00002000:00000024:3.0:1788836678.073333:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788836678.073426:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a804724ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f990379c-347e-4ded-be44-9f2a58ff1508+5:18221:x1875730511323776:12345-192.168.201.44@tcp:13:lfs.0 Request processed in 154us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836678.073434:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 16 00000100:00080000:2.0:1788836678.074792:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788836678.310001:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788836678.322114:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836678.322253:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511323904 00000100:00100000:3.0:1788836678.322263:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511323904 00000100:00100000:3.0:1788836678.322325:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 136 00000100:00100000:3.0:1788836678.322335:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814700d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ef4c47b-fc99-4862-96ec-0565fed75f8d+10:18252:x1875730511323904:12345-192.168.201.44@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788836678.322352:0:22749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836678.322369:0:22749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a80462e6200/0xbd163c7375716520 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4f244a55304e50f expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836678.322399:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a80462e6200/0xbd163c7375716520 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e50f expref: 11 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836678.322411:0:22749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a80462e6200/0xbd163c7375716520 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e50f expref: 11 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836678.322421:0:22749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a80462e6200, rc 0) 00000100:00100000:3.0:1788836678.322510:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814700d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ef4c47b-fc99-4862-96ec-0565fed75f8d+11:18252:x1875730511323904:12345-192.168.201.44@tcp:101:mount.lustre.0 Request processed in 176us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836678.322517:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 136 00000100:00100000:0.0:1788836678.335159:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836678.335286:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511324032 00000100:00100000:2.0:1788836678.335299:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511324032 00000100:00100000:2.0:1788836678.335379:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 137 00000100:00100000:2.0:1788836678.335390:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814700dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ef4c47b-fc99-4862-96ec-0565fed75f8d+11:18252:x1875730511324032:12345-192.168.201.44@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788836678.335688:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814700dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ef4c47b-fc99-4862-96ec-0565fed75f8d+11:18252:x1875730511324032:12345-192.168.201.44@tcp:501:mount.lustre.0 Request processed in 298us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836678.335697:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 137 00000100:00100000:0.0:1788836678.343825:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836678.344874:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511324160 00000100:00100000:2.0:1788836678.344891:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511324160 00000100:00100000:2.0:1788836678.344989:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 138 00000100:00100000:2.0:1788836678.345003:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814700c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ef4c47b-fc99-4862-96ec-0565fed75f8d+11:18252:x1875730511324160:12345-192.168.201.44@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788836678.345299:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814700c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ef4c47b-fc99-4862-96ec-0565fed75f8d+11:18252:x1875730511324160:12345-192.168.201.44@tcp:503:mount.lustre.0 Request processed in 299us (1491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836678.345309:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 138 00000100:00100000:1.0:1788836678.361973:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836678.362585:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511324288 00000100:00100000:3.0:1788836678.362600:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511324288 00000100:00100000:3.0:1788836678.362679:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 139 00000100:00100000:3.0:1788836678.362691:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814700d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ef4c47b-fc99-4862-96ec-0565fed75f8d+11:18258:x1875730511324288:12345-192.168.201.44@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788836678.362991:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814700d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ef4c47b-fc99-4862-96ec-0565fed75f8d+11:18258:x1875730511324288:12345-192.168.201.44@tcp:502:llog_process_th.0 Request processed in 301us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836678.363008:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 139 00000100:00100000:0.0:1788836678.388852:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836678.395524:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511324416 00000100:00100000:1.0:1788836678.395544:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511324416 00000100:00100000:1.0:1788836678.395640:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 140 00000100:00100000:1.0:1788836678.395670:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814700c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ef4c47b-fc99-4862-96ec-0565fed75f8d+11:18258:x1875730511324416:12345-192.168.201.44@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788836678.395885:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814700c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ef4c47b-fc99-4862-96ec-0565fed75f8d+11:18258:x1875730511324416:12345-192.168.201.44@tcp:502:llog_process_th.0 Request processed in 216us (7047us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836678.395895:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 140 00000100:00100000:0.0:1788836678.409561:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836678.412656:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511324544 00000100:00100000:2.0:1788836678.412678:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511324544 00000100:00100000:2.0:1788836678.412781:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 141 00000100:00100000:2.0:1788836678.412794:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814700e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ef4c47b-fc99-4862-96ec-0565fed75f8d+11:18258:x1875730511324544:12345-192.168.201.44@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788836678.413016:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814700e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ef4c47b-fc99-4862-96ec-0565fed75f8d+11:18258:x1875730511324544:12345-192.168.201.44@tcp:502:llog_process_th.0 Request processed in 224us (3463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836678.413026:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 141 00000100:00100000:2.0:1788836678.419617:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836678.419765:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511324672 00000100:00100000:3.0:1788836678.419780:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511324672 00000100:00100000:3.0:1788836678.419860:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 142 00000100:00100000:3.0:1788836678.419873:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814700d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ef4c47b-fc99-4862-96ec-0565fed75f8d+11:18252:x1875730511324672:12345-192.168.201.44@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788836678.419898:0:22749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836678.419921:0:22749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a80462e6600/0xbd163c7375716527 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4f244a55304e540 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836678.419957:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a80462e6600/0xbd163c7375716527 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e540 expref: 12 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836678.419970:0:22749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a80462e6600/0xbd163c7375716527 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e540 expref: 12 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836678.419981:0:22749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a80462e6600, rc 0) 00000100:00100000:3.0:1788836678.420192:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814700d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ef4c47b-fc99-4862-96ec-0565fed75f8d+12:18252:x1875730511324672:12345-192.168.201.44@tcp:101:mount.lustre.0 Request processed in 320us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836678.420200:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 142 00000100:00100000:0.0:1788836678.432319:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836678.433372:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511324800 00000100:00100000:1.0:1788836678.433388:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511324800 00000100:00100000:2.0:1788836678.433608:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 143 00000100:00100000:2.0:1788836678.433621:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8158daf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ef4c47b-fc99-4862-96ec-0565fed75f8d+12:18252:x1875730511324800:12345-192.168.201.44@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788836678.433665:0:22748:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788836678.433681:0:22748:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788836678.433695:0:22748:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788836678.433698:0:22748:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788836678.433701:0:22748:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788836678.433703:0:22748:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:2.0:1788836678.441599:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8158daf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ef4c47b-fc99-4862-96ec-0565fed75f8d+12:18252:x1875730511324800:12345-192.168.201.44@tcp:256:mount.lustre.0 Request processed in 7970us (9282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836678.441614:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 143 00000100:00100000:3.0:1788836678.451771:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836678.451989:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511324928 00000100:00100000:1.0:1788836678.451998:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511324928 00000100:00100000:1.0:1788836678.452060:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 144 00000100:00100000:1.0:1788836678.452070:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8158dad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ef4c47b-fc99-4862-96ec-0565fed75f8d+12:18252:x1875730511324928:12345-192.168.201.44@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788836678.452087:0:22749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836678.452105:0:22749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a817f41b200/0xbd163c737571652e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4f244a55304e547 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836678.452133:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a817f41b200/0xbd163c737571652e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e547 expref: 13 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836678.452143:0:22749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a817f41b200/0xbd163c737571652e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e547 expref: 13 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836678.452163:0:22749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a817f41b200, rc 0) 00000100:00100000:1.0:1788836678.452227:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8158dad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ef4c47b-fc99-4862-96ec-0565fed75f8d+13:18252:x1875730511324928:12345-192.168.201.44@tcp:101:mount.lustre.0 Request processed in 158us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836678.452242:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 144 00000100:00100000:0.0:1788836678.458159:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836678.458259:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511325056 00000100:00100000:2.0:1788836678.458270:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511325056 00000100:00100000:2.0:1788836678.458336:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 145 00000100:00100000:2.0:1788836678.458346:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f415450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ef4c47b-fc99-4862-96ec-0565fed75f8d+13:18252:x1875730511325056:12345-192.168.201.44@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788836678.458930:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f415450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ef4c47b-fc99-4862-96ec-0565fed75f8d+13:18252:x1875730511325056:12345-192.168.201.44@tcp:501:mount.lustre.0 Request processed in 583us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836678.458939:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 145 00000100:00100000:0.0:1788836678.462728:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836678.462914:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511325184 00000100:00100000:2.0:1788836678.462924:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511325184 00000100:00100000:2.0:1788836678.462984:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 146 00000100:00100000:2.0:1788836678.462995:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f414850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ef4c47b-fc99-4862-96ec-0565fed75f8d+13:18252:x1875730511325184:12345-192.168.201.44@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788836678.463139:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f414850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ef4c47b-fc99-4862-96ec-0565fed75f8d+13:18252:x1875730511325184:12345-192.168.201.44@tcp:503:mount.lustre.0 Request processed in 145us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836678.463146:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 146 00000100:00100000:3.0:1788836678.471924:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836678.472082:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511325312 00000100:00100000:2.0:1788836678.472092:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511325312 00000100:00100000:2.0:1788836678.472171:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 147 00000100:00100000:2.0:1788836678.472197:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f414c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ef4c47b-fc99-4862-96ec-0565fed75f8d+13:18265:x1875730511325312:12345-192.168.201.44@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788836678.472367:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f414c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ef4c47b-fc99-4862-96ec-0565fed75f8d+13:18265:x1875730511325312:12345-192.168.201.44@tcp:502:llog_process_th.0 Request processed in 171us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836678.472377:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 147 00000100:00100000:2.0:1788836678.480917:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836678.481086:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511325440 00000100:00100000:1.0:1788836678.481100:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511325440 00000100:00100000:1.0:1788836678.481184:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 148 00000100:00100000:1.0:1788836678.481197:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f417450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ef4c47b-fc99-4862-96ec-0565fed75f8d+13:18265:x1875730511325440:12345-192.168.201.44@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788836678.481416:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f417450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ef4c47b-fc99-4862-96ec-0565fed75f8d+13:18265:x1875730511325440:12345-192.168.201.44@tcp:502:llog_process_th.0 Request processed in 221us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836678.481424:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 148 00000100:00100000:0.0:1788836678.498615:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:0.0:1788836678.498666:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:0.0:1788836678.498698:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:0.0:1788836678.498736:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:0.0:1788836678.498774:0:24573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511326464 00000100:00100000:0.0:1788836678.498787:0:24573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511326464 00000100:00100000:0.0:1788836678.498852:0:24573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 12 00000100:00100000:0.0:1788836678.498864:0:24573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a804724c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f990379c-347e-4ded-be44-9f2a58ff1508+6:2408:x1875730511326464:12345-192.168.201.44@tcp:400:kworker.0 00000100:00100000:0.0:1788836678.498967:0:24573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a804724c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f990379c-347e-4ded-be44-9f2a58ff1508+6:2408:x1875730511326464:12345-192.168.201.44@tcp:400:kworker.0 Request processed in 105us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836678.498976:0:24573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 12 00000100:00100000:0.0:1788836678.499030:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:0.0:1788836678.499058:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511325568 00000100:00100000:0.0:1788836678.499061:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511325568 00000100:00100000:0.0:1788836678.499077:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511325824 00000100:00100000:0.0:1788836678.499080:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511325824 00000100:00100000:0.0:1788836678.499087:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511326208 00000100:00100000:0.0:1788836678.499089:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511326208 00000100:00100000:0.0:1788836678.499126:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511326336 00000100:00100000:0.0:1788836678.499128:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511326336 00000100:00100000:0.0:1788836678.499142:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 49 00000100:00100000:0.0:1788836678.499162:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a804724d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f990379c-347e-4ded-be44-9f2a58ff1508+7:2408:x1875730511326208:12345-192.168.201.44@tcp:400:kworker.0 00000100:00100000:0.0:1788836678.499201:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a804724d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f990379c-347e-4ded-be44-9f2a58ff1508+7:2408:x1875730511326208:12345-192.168.201.44@tcp:400:kworker.0 Request processed in 52us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836678.499207:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 49 00000100:00100000:0.0:1788836678.499221:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 50 00000100:00100000:0.0:1788836678.499227:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8151554e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f990379c-347e-4ded-be44-9f2a58ff1508+6:2408:x1875730511326336:12345-192.168.201.44@tcp:400:kworker.0 00000100:00100000:0.0:1788836678.499276:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8151554e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f990379c-347e-4ded-be44-9f2a58ff1508+6:2408:x1875730511326336:12345-192.168.201.44@tcp:400:kworker.0 Request processed in 47us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836678.499283:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 50 00000100:00100000:0.0:1788836678.499296:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 16 00000100:00100000:0.0:1788836678.499299:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a804724ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2407:x1875730511325568:12345-192.168.201.44@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788836678.499331:0:22755:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 397edcbf-83fc-4215-a82a-1f239b89b4e7@192.168.201.44@tcp t0 exp 0000000000000000 cur 708 last 0 00000020:00000080:0.0:1788836678.499381:0:22755:0:(genops.c:1385:class_connect()) connect: client 397edcbf-83fc-4215-a82a-1f239b89b4e7, cookie 0xbd163c7375716535 00000004:00100000:0.0:1788836678.499415:0:22755:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:0.0:1788836678.499589:0:22755:0:(import.c:65:import_set_state_nolock()) ffff9a81735e6800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788836678.499622:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a804724ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397edcbf-83fc-4215-a82a-1f239b89b4e7+6:2407:x1875730511325568:12345-192.168.201.44@tcp:38:mount.lustre.0 Request processed in 320us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836678.499630:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 16 00000100:00100000:0.0:1788836678.499645:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 17 00000100:00100000:0.0:1788836678.499649:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a804724d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2407:x1875730511325824:12345-192.168.201.44@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788836678.499666:0:22755:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 397edcbf-83fc-4215-a82a-1f239b89b4e7@192.168.201.44@tcp t0 exp 0000000000000000 cur 708 last 0 00000020:00000080:0.0:1788836678.499699:0:22755:0:(genops.c:1385:class_connect()) connect: client 397edcbf-83fc-4215-a82a-1f239b89b4e7, cookie 0xbd163c737571653c 00000004:00100000:0.0:1788836678.499712:0:22755:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:0.0:1788836678.499759:0:22755:0:(import.c:65:import_set_state_nolock()) ffff9a81735e5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788836678.499782:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a804724d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397edcbf-83fc-4215-a82a-1f239b89b4e7+6:2407:x1875730511325824:12345-192.168.201.44@tcp:38:mount.lustre.0 Request processed in 132us (1116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836678.499789:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 17 00000100:00100000:0.0:1788836678.499876:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836678.501689:0:24263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511326592 00000100:00100000:2.0:1788836678.501706:0:24263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511326592 00000100:00100000:2.0:1788836678.501792:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 13 00000100:00100000:2.0:1788836678.501804:0:24263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8151557800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f990379c-347e-4ded-be44-9f2a58ff1508+5:2408:x1875730511326592:12345-192.168.201.44@tcp:400:kworker.0 00000100:00100000:2.0:1788836678.501894:0:24263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8151557800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f990379c-347e-4ded-be44-9f2a58ff1508+5:2408:x1875730511326592:12345-192.168.201.44@tcp:400:kworker.0 Request processed in 92us (2016us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836678.501902:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 13 00000100:00100000:3.0:1788836678.504037:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8048e77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875730518796032:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788836678.504132:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836678.504373:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518796032 00000100:00100000:2.0:1788836678.504383:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518796032 00000100:00100000:2.0:1788836678.504449:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788836678.504491:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166e96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875730518796032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788836678.504689:0:22761:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788836678.504750:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166e96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875730518796032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 290us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836678.504758:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788836678.504856:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8048e77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875730518796032:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788836678.506918:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836678.506961:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836678.507083:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511326080 00000100:00100000:3.0:1788836678.507095:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511326080 00000100:00100000:3.0:1788836678.507175:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511325696 00000100:00100000:3.0:1788836678.507179:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511325696 00000100:00100000:3.0:1788836678.507202:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 18 00000100:00100000:3.0:1788836678.507214:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166e95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397edcbf-83fc-4215-a82a-1f239b89b4e7+7:18252:x1875730511326080:12345-192.168.201.44@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788836678.507250:0:22754:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788836678.507328:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166e95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397edcbf-83fc-4215-a82a-1f239b89b4e7+7:18252:x1875730511326080:12345-192.168.201.44@tcp:41:mount.lustre.0 Request processed in 116us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836678.507337:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 18 00000100:00100000:3.0:1788836678.507355:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 19 00000100:00100000:3.0:1788836678.507362:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166e94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397edcbf-83fc-4215-a82a-1f239b89b4e7+6:0:x1875730511325696:12345-192.168.201.44@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788836678.507373:0:22754:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788836678.507395:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166e94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397edcbf-83fc-4215-a82a-1f239b89b4e7+6:0:x1875730511325696:12345-192.168.201.44@tcp:41:mount.lustre.0 Request processed in 34us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836678.507401:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 19 00000100:00080000:2.0:1788836678.508046:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788836678.508194:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8048e77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875730518796160:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788836678.508269:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836678.508647:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518796160 00000100:00100000:2.0:1788836678.508655:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518796160 00000100:00100000:2.0:1788836678.508706:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788836678.508717:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8172d96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875730518796160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788836678.508742:0:22760:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788836678.508813:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8172d96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875730518796160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836678.508821:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788836678.508958:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8048e77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875730518796160:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788836678.510355:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836678.510426:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511325952 00000100:00100000:2.0:1788836678.510437:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511325952 00000100:00080000:0.0:1788836678.510907:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788836678.511038:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 20 00000100:00100000:2.0:1788836678.511051:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166e94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397edcbf-83fc-4215-a82a-1f239b89b4e7+6:0:x1875730511325952:12345-192.168.201.44@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788836678.511121:0:22754:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788836678.511221:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166e94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397edcbf-83fc-4215-a82a-1f239b89b4e7+6:0:x1875730511325952:12345-192.168.201.44@tcp:41:mount.lustre.0 Request processed in 173us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836678.511230:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 20 00000100:00100000:0.0:1788836678.523223:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836678.523940:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511326720 00000100:00100000:1.0:1788836678.523954:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511326720 00000100:00100000:1.0:1788836678.524050:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 21 00000100:00100000:1.0:1788836678.524063:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8151555500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397edcbf-83fc-4215-a82a-1f239b89b4e7+6:18252:x1875730511326720:12345-192.168.201.44@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788836678.524972:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8151555500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397edcbf-83fc-4215-a82a-1f239b89b4e7+6:18252:x1875730511326720:12345-192.168.201.44@tcp:40:mount.lustre.0 Request processed in 905us (1763us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836678.524986:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 21 00000100:00100000:3.0:1788836678.527900:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836678.528037:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511327104 00000100:00100000:2.0:1788836678.528051:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511327104 00000100:00100000:2.0:1788836678.528142:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 4 00000100:00100000:2.0:1788836678.528186:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166e94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:397edcbf-83fc-4215-a82a-1f239b89b4e7+6:18252:x1875730511327104:12345-192.168.201.44@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788836678.528309:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166e94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:397edcbf-83fc-4215-a82a-1f239b89b4e7+6:18252:x1875730511327104:12345-192.168.201.44@tcp:900:mount.lustre.0 Request processed in 157us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836678.528319:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 4 00000100:00100000:1.0:1788836678.530359:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836678.530607:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:0.0:1788836678.531274:0:24573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511326848 00000100:00100000:0.0:1788836678.531289:0:24573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511326848 00000100:00100000:0.0:1788836678.531493:0:24573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511326976 00000100:00100000:0.0:1788836678.531506:0:24573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511326976 00000100:00100000:2.0:1788836678.531609:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 23 00000100:00100000:2.0:1788836678.531621:0:24263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8148619180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2407:x1875730511326848:12345-192.168.201.44@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788836678.531669:0:24263:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 397edcbf-83fc-4215-a82a-1f239b89b4e7@192.168.201.44@tcp t0 exp 0000000000000000 cur 708 last 0 00000020:00000080:2.0:1788836678.531709:0:24263:0:(genops.c:1385:class_connect()) connect: client 397edcbf-83fc-4215-a82a-1f239b89b4e7, cookie 0xbd163c7375716543 00002000:00100000:2.0:1788836678.531724:0:24263:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 397edcbf-83fc-4215-a82a-1f239b89b4e7/ffff9a8047df2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788836678.531736:0:24263:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:2.0:1788836678.531838:0:24263:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788836678.531880:0:24263:0:(import.c:65:import_set_state_nolock()) ffff9a8047df0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788836678.531976:0:24263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8148619180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:397edcbf-83fc-4215-a82a-1f239b89b4e7+6:2407:x1875730511326848:12345-192.168.201.44@tcp:8:mount.lustre.0 Request processed in 355us (1628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836678.531986:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 23 00000100:00100000:2.0:1788836678.532017:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 24 00000100:00100000:2.0:1788836678.532023:0:24263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814861a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2407:x1875730511326976:12345-192.168.201.44@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788836678.532040:0:24263:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 397edcbf-83fc-4215-a82a-1f239b89b4e7@192.168.201.44@tcp t0 exp 0000000000000000 cur 708 last 0 00000020:00000080:2.0:1788836678.532061:0:24263:0:(genops.c:1385:class_connect()) connect: client 397edcbf-83fc-4215-a82a-1f239b89b4e7, cookie 0xbd163c737571654a 00002000:00100000:2.0:1788836678.532067:0:24263:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 397edcbf-83fc-4215-a82a-1f239b89b4e7/ffff9a8047df4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788836678.532073:0:24263:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:2.0:1788836678.532121:0:24263:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788836678.532137:0:24263:0:(import.c:65:import_set_state_nolock()) ffff9a804743c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788836678.532175:0:24263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814861a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:397edcbf-83fc-4215-a82a-1f239b89b4e7+6:2407:x1875730511326976:12345-192.168.201.44@tcp:8:mount.lustre.0 Request processed in 150us (1568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836678.532181:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 24 00000100:00100000:1.0:1788836678.534877:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836678.538810:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511327232 00000100:00100000:3.0:1788836678.538833:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511327232 00000100:00100000:3.0:1788836678.538919:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 1 00000100:00100000:3.0:1788836678.538932:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814861bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:397edcbf-83fc-4215-a82a-1f239b89b4e7+6:18252:x1875730511327232:12345-192.168.201.44@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788836678.539062:0:22758:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788836678.539193:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814861bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:397edcbf-83fc-4215-a82a-1f239b89b4e7+6:18252:x1875730511327232:12345-192.168.201.44@tcp:33:mount.lustre.0 Request processed in 263us (4328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836678.539202:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 1 00000100:00100000:3.0:1788836678.764315:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:0.0:1788836678.764515:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511327360 00000100:00100000:0.0:1788836678.764530:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511327360 00000100:00100000:0.0:1788836678.764609:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 22 00000100:00100000:0.0:1788836678.764622:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166e94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397edcbf-83fc-4215-a82a-1f239b89b4e7+6:18288:x1875730511327360:12345-192.168.201.44@tcp:101:mkdir.0 00010000:00010000:0.0:1788836678.764650:0:22754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836678.764681:0:22754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c7375716551 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4f244a55304e578 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836678.764766:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158e000/0xbd163c7375716558 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836678.764784:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158e000/0xbd163c7375716558 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836678.764798:0:22754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158e000/0xbd163c7375716558 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836678.764880:0:22754:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788836678.764885:0:22754:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788836678.764911:0:22754:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158e000/0xbd163c7375716558 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836678.764943:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c7375716551 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e578 expref: 8 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836678.764968:0:22754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158e000/0xbd163c7375716558 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e578 expref: 7 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836678.764978:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8164675c00) 00010000:00010000:0.0:1788836678.764982:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788836678.764986:0:22754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a815158e000, rc 0) 00000100:00100000:0.0:1788836678.765080:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166e94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397edcbf-83fc-4215-a82a-1f239b89b4e7+7:18288:x1875730511327360:12345-192.168.201.44@tcp:101:mkdir.0 Request processed in 459us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836678.765088:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 22 00010000:00010000:0.0:1788836679.337089:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788836679.399949:0:23516:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788836680.357728:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836680.549802:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788836680.549827:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8151557480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875730518796288:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788836680.549893:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836680.550002:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518796288 00000100:00100000:0.0:1788836680.550011:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518796288 00000100:00100000:0.0:1788836680.550078:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788836680.550088:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166e94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875730518796288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788836680.550125:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788836680.550172:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166e94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875730518796288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836680.550195:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1788836680.550263:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788836680.550320:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8151557480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875730518796288:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788836680.550670:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788836680.550680:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8166e96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875730518796416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788836680.550709:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836680.550774:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518796416 00000100:00100000:3.0:1788836680.550778:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518796416 00000100:00100000:3.0:1788836680.550820:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788836680.550827:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8151556d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875730518796416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788836680.550839:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788836680.550870:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8151556d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875730518796416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836680.550876:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788836680.550900:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:3.0:1788836680.550957:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8166e96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875730518796416:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788836680.551010:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788836680.551362:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8148619f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875730518796672:0@lo:400:kworker.0 00000100:00100000:1.0:1788836680.551398:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836680.551456:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a814861a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875730518797184:0@lo:400:kworker.0 00000100:00100000:3.0:1788836680.551558:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a814861aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d9f3bec-9812-4f3e-be22-5440158bfa78:3620:1875730518796544:0@lo:400:kworker.0 00000100:00100000:3.0:1788836680.551592:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836680.551616:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a814861b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875730518797056:0@lo:400:kworker.0 00000100:00100000:3.0:1788836680.551637:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836680.551650:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a814861b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875730518797568:0@lo:400:kworker.0 00000100:00100000:3.0:1788836680.551670:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836680.551746:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518796672 00000100:00100000:2.0:1788836680.551752:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518796672 00000100:00100000:2.0:1788836680.551790:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518797056 00000100:00100000:2.0:1788836680.551793:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518797056 00000100:00100000:2.0:1788836680.551807:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788836680.551814:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814861b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875730518796672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836680.551856:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814861b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875730518796672:12345-0@lo:400:kworker.0 Request processed in 41us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836680.551862:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788836680.551876:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788836680.551893:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166e96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875730518797056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836680.551926:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166e96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875730518797056:12345-0@lo:400:kworker.0 Request processed in 35us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836680.551932:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788836680.551951:0:24288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518797568 00000100:00100000:2.0:1788836680.551954:0:24288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518797568 00000100:00100000:2.0:1788836680.551987:0:24288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788836680.551992:0:24288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166e96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875730518797568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836680.552022:0:24288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166e96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875730518797568:12345-0@lo:400:kworker.0 Request processed in 30us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836680.552028:0:24288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1788836680.552044:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788836680.552063:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a814861b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875730518797056:0@lo:400:kworker.0 00010000:00080000:2.0:1788836680.552076:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a814861b800 x1875730518797568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836680.552085:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a814861b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875730518797568:0@lo:400:kworker.0 00000100:00100000:2.0:1788836680.552131:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8148618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875730518796800:0@lo:400:kworker.0 00000100:00100000:2.0:1788836680.552160:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836680.552181:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8148619880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875730518797312:0@lo:400:kworker.0 00000100:00100000:2.0:1788836680.552201:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836680.552216:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8148619500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875730518797824:0@lo:400:kworker.0 00000100:00100000:2.0:1788836680.552238:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836680.552252:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788836680.552258:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8148618a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875730518796928:0@lo:400:kworker.0 00000100:00100000:2.0:1788836680.552290:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836680.552307:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8148618e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875730518797440:0@lo:400:kworker.0 00000100:00100000:2.0:1788836680.552324:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836680.552345:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518797312 00000100:00100000:2.0:1788836680.552348:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518797312 00000100:00100000:2.0:1788836680.552363:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518797824 00000100:00100000:2.0:1788836680.552366:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518797824 00000100:00100000:2.0:1788836680.552380:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518796928 00000100:00100000:2.0:1788836680.552382:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518796928 00000100:00100000:2.0:1788836680.552391:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518797440 00000100:00100000:2.0:1788836680.552393:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518797440 00000100:00100000:2.0:1788836680.552406:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788836680.552412:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8048e77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875730518797312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836680.552444:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8048e77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875730518797312:12345-0@lo:400:kworker.0 Request processed in 32us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836680.552450:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788836680.552565:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788836680.552572:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8047444e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875730518797824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836680.552602:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8047444e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875730518797824:12345-0@lo:400:kworker.0 Request processed in 31us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836680.552608:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788836680.552620:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788836680.552626:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8047447480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875730518796928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836680.552654:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8047447480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875730518796928:12345-0@lo:400:kworker.0 Request processed in 28us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836680.552660:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788836680.552670:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788836680.552684:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8047444700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875730518797440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836680.552712:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8047444700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875730518797440:12345-0@lo:400:kworker.0 Request processed in 30us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836680.552719:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:2.0:1788836680.552734:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788836680.552737:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788836680.552760:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8148618a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875730518796928:0@lo:400:kworker.0 00000100:00100000:2.0:1788836680.552769:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8148618e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875730518797440:0@lo:400:kworker.0 00000100:00100000:2.0:1788836680.552778:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8148619880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875730518797312:0@lo:400:kworker.0 00010000:00080000:2.0:1788836680.552787:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a8148619500 x1875730518797824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836680.552795:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8148619500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875730518797824:0@lo:400:kworker.0 00000100:00100000:2.0:1788836680.552830:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518796544 00000100:00100000:2.0:1788836680.552833:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518796544 00000100:00100000:2.0:1788836680.552861:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788836680.552868:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f415c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+24:3620:x1875730518796544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836680.552904:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f415c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+24:3620:x1875730518796544:12345-0@lo:400:kworker.0 Request processed in 36us (1311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836680.552910:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788836680.552940:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a814861aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d9f3bec-9812-4f3e-be22-5440158bfa78:3620:1875730518796544:0@lo:400:kworker.0 00000100:00100000:2.0:1788836680.552968:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518796800 00000100:00100000:2.0:1788836680.552972:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518796800 00000100:00100000:2.0:1788836680.553002:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788836680.553008:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8048e76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875730518796800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836680.553053:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8048e76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875730518796800:12345-0@lo:400:kworker.0 Request processed in 45us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836680.553059:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1788836680.553074:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788836680.553090:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8148618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875730518796800:0@lo:400:kworker.0 00000100:00100000:1.0:1788836680.553265:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836680.553327:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a814861ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1875730518797696:0@lo:400:kworker.0 00000100:00100000:1.0:1788836680.553349:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836680.553388:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8148619f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875730518796672:0@lo:400:kworker.0 00000100:00100000:3.0:1788836680.553449:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518797184 00000100:00100000:3.0:1788836680.553454:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518797184 00000100:00100000:3.0:1788836680.553525:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788836680.553532:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8180d1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875730518797184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836680.553574:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8180d1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875730518797184:12345-0@lo:400:kworker.0 Request processed in 42us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836680.553579:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1788836680.553786:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788836680.553808:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a814861a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875730518797184:0@lo:400:kworker.0 00000100:00100000:2.0:1788836680.553874:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518797696 00000100:00100000:2.0:1788836680.553877:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518797696 00000100:00100000:2.0:1788836680.553937:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788836680.553942:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8148619c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875730518797696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836680.553967:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8148619c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875730518797696:12345-0@lo:400:kworker.0 Request processed in 26us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836680.553971:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788836680.554068:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a814861ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1875730518797696:0@lo:400:kworker.0 00000100:00080000:1.0:1788836680.554338:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:2.0:1788836681.067572:0:22735:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 397edcbf-83fc-4215-a82a-1f239b89b4e7 00000001:00100000:2.0:1788836681.067585:0:22735:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f990379c-347e-4ded-be44-9f2a58ff1508 00000001:00100000:3.0:1788836681.074059:0:24260:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 397edcbf-83fc-4215-a82a-1f239b89b4e7 00000001:00100000:3.0:1788836681.074075:0:24260:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f990379c-347e-4ded-be44-9f2a58ff1508 00000001:00100000:1.0:1788836681.077309:0:23490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 397edcbf-83fc-4215-a82a-1f239b89b4e7 00000001:00100000:1.0:1788836681.077321:0:23490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f990379c-347e-4ded-be44-9f2a58ff1508 00010000:00010000:1.0:1788836681.386209:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788836681.799133:0:25637:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788836682.405675:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836682.598092:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788836682.598115:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8151554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875730518797952:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788836682.598186:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836682.598305:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518797952 00000100:00100000:0.0:1788836682.598313:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518797952 00000100:00100000:0.0:1788836682.598375:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788836682.598385:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814861a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875730518797952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788836682.598413:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788836682.598457:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814861a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875730518797952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836682.598501:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1788836682.598670:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788836682.598715:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788836682.598724:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8148619f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875730518798080:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788836682.598751:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836682.598803:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8151554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875730518797952:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788836682.598823:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518798080 00000100:00100000:1.0:1788836682.598827:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518798080 00000100:00100000:1.0:1788836682.598870:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788836682.598876:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8148618000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875730518798080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788836682.598886:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788836682.598922:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8148618000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875730518798080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 46us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836682.598929:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1788836682.598944:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788836682.598976:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8148619f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875730518798080:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788836683.429867:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836683.622656:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788836683.622676:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8166e96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875730518798208:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788836683.622796:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836683.622830:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788836683.622837:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8166e95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875730518798336:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788836683.622858:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836683.622942:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518798208 00000100:00100000:3.0:1788836683.622950:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518798208 00000100:00100000:3.0:1788836683.622993:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518798336 00000100:00100000:3.0:1788836683.622996:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518798336 00000100:00100000:3.0:1788836683.623016:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788836683.623024:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166e95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875730518798208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788836683.623067:0:22761:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788836683.623122:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166e95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875730518798208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836683.623129:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788836683.623146:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788836683.623154:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8181bac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875730518798336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788836683.623184:0:22761:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788836683.623224:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8181bac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875730518798336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836683.623242:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788836683.623354:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8166e95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875730518798336:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788836683.623388:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8166e96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875730518798208:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788836683.636187:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836683.636261:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836683.636296:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836683.636330:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836683.636372:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836683.636403:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836683.636440:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511327744 00000100:00100000:1.0:1788836683.636450:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511327744 00000100:00100000:0.0:1788836683.636637:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511327488 00000100:00100000:0.0:1788836683.636643:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511327488 00000100:00100000:0.0:1788836683.636684:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 150 00000100:00100000:0.0:1788836683.636696:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f414450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ef4c47b-fc99-4862-96ec-0565fed75f8d+13:2411:x1875730511327488:12345-192.168.201.44@tcp:400:kworker.0 00000100:00100000:0.0:1788836683.636766:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f414450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ef4c47b-fc99-4862-96ec-0565fed75f8d+13:2411:x1875730511327488:12345-192.168.201.44@tcp:400:kworker.0 Request processed in 71us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836683.636774:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 150 00000100:00100000:1.0:1788836683.636898:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511328256 00000100:00100000:1.0:1788836683.636903:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511328256 00000100:00100000:1.0:1788836683.636930:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511327616 00000100:00100000:1.0:1788836683.636933:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511327616 00000100:00100000:1.0:1788836683.636953:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 57 00000100:00100000:1.0:1788836683.636962:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8148619f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f990379c-347e-4ded-be44-9f2a58ff1508+5:2411:x1875730511327744:12345-192.168.201.44@tcp:400:kworker.0 00000100:00100000:1.0:1788836683.637000:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8148619f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f990379c-347e-4ded-be44-9f2a58ff1508+5:2411:x1875730511327744:12345-192.168.201.44@tcp:400:kworker.0 Request processed in 39us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836683.637008:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 57 00000100:00100000:1.0:1788836683.637022:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 58 00000100:00100000:1.0:1788836683.637029:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814861ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397edcbf-83fc-4215-a82a-1f239b89b4e7+5:2411:x1875730511328256:12345-192.168.201.44@tcp:400:kworker.0 00000100:00100000:1.0:1788836683.637055:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814861ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397edcbf-83fc-4215-a82a-1f239b89b4e7+5:2411:x1875730511328256:12345-192.168.201.44@tcp:400:kworker.0 Request processed in 26us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836683.637070:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 58 00000100:00100000:1.0:1788836683.637083:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 59 00000100:00100000:1.0:1788836683.637088:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814861a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f990379c-347e-4ded-be44-9f2a58ff1508+6:2410:x1875730511327616:12345-192.168.201.44@tcp:400:kworker.0 00000100:00100000:1.0:1788836683.637112:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814861a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f990379c-347e-4ded-be44-9f2a58ff1508+6:2410:x1875730511327616:12345-192.168.201.44@tcp:400:kworker.0 Request processed in 24us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836683.637119:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 59 00000100:00100000:1.0:1788836683.637150:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511328000 00000100:00100000:1.0:1788836683.637154:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511328000 00000100:00100000:1.0:1788836683.637186:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511328512 00000100:00100000:1.0:1788836683.637195:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511328512 00000100:00100000:1.0:1788836683.637226:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 16 00000100:00100000:1.0:1788836683.637236:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8148618380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f990379c-347e-4ded-be44-9f2a58ff1508+5:2411:x1875730511328000:12345-192.168.201.44@tcp:400:kworker.0 00000100:00100000:1.0:1788836683.637266:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8148618380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f990379c-347e-4ded-be44-9f2a58ff1508+5:2411:x1875730511328000:12345-192.168.201.44@tcp:400:kworker.0 Request processed in 33us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836683.637272:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 16 00000100:00100000:1.0:1788836683.637283:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 17 00000100:00100000:1.0:1788836683.637289:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8148619180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:397edcbf-83fc-4215-a82a-1f239b89b4e7+6:2411:x1875730511328512:12345-192.168.201.44@tcp:400:kworker.0 00000100:00100000:1.0:1788836683.637309:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8148619180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:397edcbf-83fc-4215-a82a-1f239b89b4e7+6:2411:x1875730511328512:12345-192.168.201.44@tcp:400:kworker.0 Request processed in 21us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836683.637315:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 17 00000100:00080000:1.0:1788836683.637333:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788836683.637337:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788836683.637339:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788836683.637368:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836683.637425:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836683.637455:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836683.638098:0:24573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511327872 00000100:00100000:1.0:1788836683.638104:0:24573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511327872 00000100:00100000:1.0:1788836683.638138:0:24573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511328384 00000100:00100000:1.0:1788836683.638191:0:24573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511328384 00000100:00100000:1.0:1788836683.638212:0:24573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 18 00000100:00100000:1.0:1788836683.638219:0:24573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8148618700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f990379c-347e-4ded-be44-9f2a58ff1508+5:2410:x1875730511327872:12345-192.168.201.44@tcp:400:kworker.0 00000100:00100000:1.0:1788836683.638257:0:24573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8148618700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f990379c-347e-4ded-be44-9f2a58ff1508+5:2410:x1875730511327872:12345-192.168.201.44@tcp:400:kworker.0 Request processed in 38us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836683.638263:0:24573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 18 00000100:00100000:1.0:1788836683.638284:0:24573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 19 00000100:00100000:1.0:1788836683.638290:0:24573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8148619500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:397edcbf-83fc-4215-a82a-1f239b89b4e7+5:2410:x1875730511328384:12345-192.168.201.44@tcp:400:kworker.0 00000100:00100000:1.0:1788836683.638314:0:24573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8148619500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:397edcbf-83fc-4215-a82a-1f239b89b4e7+5:2410:x1875730511328384:12345-192.168.201.44@tcp:400:kworker.0 Request processed in 24us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836683.638320:0:24573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 19 00000100:00100000:1.0:1788836683.638337:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511328128 00000100:00100000:1.0:1788836683.638340:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511328128 00000100:00100000:1.0:1788836683.638360:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 60 00000100:00100000:1.0:1788836683.638365:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814861aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397edcbf-83fc-4215-a82a-1f239b89b4e7+6:2410:x1875730511328128:12345-192.168.201.44@tcp:400:kworker.0 00000100:00100000:1.0:1788836683.638385:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814861aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397edcbf-83fc-4215-a82a-1f239b89b4e7+6:2410:x1875730511328128:12345-192.168.201.44@tcp:400:kworker.0 Request processed in 20us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836683.638390:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 60 00000100:00080000:0.0:1788836683.638618:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788836683.638622:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1788836684.137793:0:25081:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 397edcbf-83fc-4215-a82a-1f239b89b4e7 00010000:00010000:1.0:1788836684.457270:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788836684.776278:0:22791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788836685.477565:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788836685.567716:0:25785:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe13a67570 20000000:00000080:1.0:1788836685.567731:0:25785:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a8180d70000 uarg=0000000000000000 20000000:01000000:1.0:1788836685.567764:0:25785:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788836685.567768:0:25785:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788836685.567772:0:25785:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788836685.575278:0:25786:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1788836685.575451:0:25785:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788836685.578292:0:25785:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788836685.578327:0:25785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a80462e7a00/0xbd163c737571655f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836685.578348:0:25785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a80462e7200/0xbd163c73757161bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd163c73757161b5 expref: 23 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836685.578354:0:25785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a817f41a800/0xbd163c73757161ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd163c73757161c3 expref: 23 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836685.578359:0:25785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a80462e7000/0xbd163c7375716209 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd163c7375716202 expref: 23 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836685.578363:0:25785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a817ed15400/0xbd163c7375716383 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd163c737571637c expref: 23 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836685.578369:0:25785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a817f41be00/0xbd163c73757164ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e4d7 expref: 12 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836685.578373:0:25785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a817f41b200/0xbd163c737571652e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e547 expref: 12 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836685.578377:0:25785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a80462e7a00/0xbd163c737571655f lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836685.578432:0:25785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a817f41b200/0xbd163c737571652e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e547 expref: 12 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836685.578445:0:25785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a817f41b200/0xbd163c737571652e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e547 expref: 12 pid: 22749 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836685.578456:0:25785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8181baf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25785:1875730518798464:192.168.201.44@tcp:104: 00010000:00010000:3.0:1788836685.578575:0:25785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a817f41be00/0xbd163c73757164ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e4d7 expref: 12 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836685.578584:0:25785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a817f41be00/0xbd163c73757164ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e4d7 expref: 12 pid: 22750 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836685.578593:0:25785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8181baea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25785:1875730518798592:192.168.201.44@tcp:104: 00010000:00010000:3.0:1788836685.578623:0:25785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a817ed15400/0xbd163c7375716383 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd163c737571637c expref: 23 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836685.578629:0:25785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a817ed15400/0xbd163c7375716383 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd163c737571637c expref: 23 pid: 22748 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836685.578636:0:25785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8181baed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25785:1875730518798720:0@lo:104: 00000100:00100000:3.0:1788836685.578665:0:25785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788836685.578699:0:25785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a80462e7000/0xbd163c7375716209 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd163c7375716202 expref: 23 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836685.578708:0:25785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a80462e7000/0xbd163c7375716209 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd163c7375716202 expref: 23 pid: 22749 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836685.578727:0:25785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8166e96a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25785:1875730518798848:0@lo:104: 00000100:00100000:3.0:1788836685.578744:0:25785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836685.578774:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518798720 00000100:00100000:3.0:1788836685.578779:0:22738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518798720 00000100:00100000:3.0:1788836685.578811:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518798848 00000100:00100000:3.0:1788836685.578812:0:22738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518798848 00000100:00100000:3.0:1788836685.578821:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788836685.578827:0:22738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8181baf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d9f3bec-9812-4f3e-be22-5440158bfa78+4:25785:x1875730518798720:12345-0@lo:104: 00010000:00010000:3.0:1788836685.578836:0:22738:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.144@tcp lock: ffff9a817f41aa00/0xbd163c737571637c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd163c7375716383 expref: -99 pid: 25080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836685.578867:0:22738:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788836685.578871:0:22738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8181baf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d9f3bec-9812-4f3e-be22-5440158bfa78+4:25785:x1875730518798720:12345-0@lo:104: Request processed in 45us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836685.578875:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788836685.578887:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788836685.578891:0:22738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166e95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d9f3bec-9812-4f3e-be22-5440158bfa78+3:25785:x1875730518798848:12345-0@lo:104: 00010000:00010000:3.0:1788836685.578895:0:22738:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.144@tcp lock: ffff9a804738c800/0xbd163c7375716202 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd163c7375716209 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836685.578913:0:22738:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788836685.578916:0:22738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166e95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d9f3bec-9812-4f3e-be22-5440158bfa78+3:25785:x1875730518798848:12345-0@lo:104: Request processed in 26us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836685.578920:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1788836685.578941:0:25785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a817f41a800/0xbd163c73757161ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd163c73757161c3 expref: 23 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836685.578953:0:25785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a817f41a800/0xbd163c73757161ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd163c73757161c3 expref: 23 pid: 22749 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836685.578959:0:25785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a81412e9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25785:1875730518798976:0@lo:104: 00000100:00100000:3.0:1788836685.578974:0:25785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836685.578987:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518798976 00000100:00100000:3.0:1788836685.578990:0:22738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518798976 00000100:00100000:3.0:1788836685.579003:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788836685.579008:0:22738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a80455a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d9f3bec-9812-4f3e-be22-5440158bfa78+3:25785:x1875730518798976:12345-0@lo:104: 00010000:00010000:3.0:1788836685.579015:0:22738:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.144@tcp lock: ffff9a80462e7e00/0xbd163c73757161c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd163c73757161ca expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836685.580269:0:23912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788836685.580276:0:23912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.144@tcp lock: ffff9a817f41aa00/0xbd163c737571637c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd163c7375716383 expref: -99 pid: 25080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836685.580284:0:23912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a817f41aa00 already unused, calling callback (ffffffffc139ec20) 10000000:00010000:0.0:1788836685.580288:0:23912:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.144@tcp lock: ffff9a817f41aa00/0xbd163c737571637c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd163c7375716383 expref: -99 pid: 25080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836685.580297:0:23912:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.144@tcp lock: ffff9a817f41aa00/0xbd163c737571637c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd163c7375716383 expref: -99 pid: 25080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788836685.580304:0:23912:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.144@tcp lock: ffff9a817f41aa00/0xbd163c737571637c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd163c7375716383 expref: -99 pid: 25080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836685.580310:0:23912:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788836685.580351:0:23912:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.144@tcp lock: ffff9a817f41aa00/0xbd163c737571637c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd163c7375716383 expref: -99 pid: 25080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836685.580356:0:23912:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788836685.580377:0:23912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.144@tcp lock: ffff9a817f41aa00/0xbd163c737571637c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd163c7375716383 expref: -99 pid: 25080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836685.580382:0:23912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.144@tcp lock: ffff9a817f41aa00/0xbd163c737571637c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd163c7375716383 expref: -99 pid: 25080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836685.580390:0:23912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836685.580392:0:23912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.144@tcp lock: ffff9a804738c800/0xbd163c7375716202 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd163c7375716209 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836685.580396:0:23912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a804738c800 already unused, calling callback (ffffffffc139ec20) 10000000:00010000:0.0:1788836685.580405:0:23912:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.144@tcp lock: ffff9a804738c800/0xbd163c7375716202 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd163c7375716209 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836685.580410:0:23912:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.144@tcp lock: ffff9a804738c800/0xbd163c7375716202 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd163c7375716209 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788836685.580414:0:23912:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.144@tcp lock: ffff9a804738c800/0xbd163c7375716202 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd163c7375716209 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836685.580418:0:23912:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788836685.580427:0:23912:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.144@tcp lock: ffff9a804738c800/0xbd163c7375716202 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd163c7375716209 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836685.580430:0:23912:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788836685.580440:0:23912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.144@tcp lock: ffff9a804738c800/0xbd163c7375716202 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd163c7375716209 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836685.580444:0:23912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.144@tcp lock: ffff9a804738c800/0xbd163c7375716202 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd163c7375716209 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836685.580449:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836685.580450:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836685.580451:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836685.580481:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8151554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d9f3bec-9812-4f3e-be22-5440158bfa78:3619:1875730518799104:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788836685.580511:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836685.580559:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8151555c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d9f3bec-9812-4f3e-be22-5440158bfa78:3620:1875730518799232:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788836685.580726:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836685.580756:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518799104 00000100:00100000:0.0:1788836685.580759:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518799104 00010000:00010000:0.0:1788836685.580777:0:22740:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a817ed15400/0xbd163c7375716383 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd163c737571637c expref: 24 pid: 22748 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836685.580799:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518799232 00000100:00100000:0.0:1788836685.580801:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518799232 00010000:00010000:0.0:1788836685.580808:0:22740:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a80462e7000/0xbd163c7375716209 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd163c7375716202 expref: 25 pid: 22749 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836685.580819:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788836685.580823:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8151556300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d9f3bec-9812-4f3e-be22-5440158bfa78+25:3619:x1875730518799104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788836685.580831:0:22740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836685.580834:0:22740:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a817ed15400/0xbd163c7375716383 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd163c737571637c expref: 25 pid: 22748 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836685.580840:0:22740:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a817ed15400/0xbd163c7375716383 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd163c737571637c expref: 25 pid: 22748 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836685.580851:0:22740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836685.580872:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8151556300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d9f3bec-9812-4f3e-be22-5440158bfa78+25:3619:x1875730518799104:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836685.580876:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788836685.580886:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788836685.580890:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8151555f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d9f3bec-9812-4f3e-be22-5440158bfa78+24:3620:x1875730518799232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788836685.580894:0:22740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836685.580896:0:22740:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a80462e7000/0xbd163c7375716209 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd163c7375716202 expref: 24 pid: 22749 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836685.580901:0:22740:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a80462e7000/0xbd163c7375716209 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd163c7375716202 expref: 24 pid: 22749 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836685.580907:0:22740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836685.580927:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8151555f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d9f3bec-9812-4f3e-be22-5440158bfa78+24:3620:x1875730518799232:12345-0@lo:103:ldlm_bl.0 Request processed in 37us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836685.580931:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788836685.580959:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8151555c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5d9f3bec-9812-4f3e-be22-5440158bfa78:3620:1875730518799232:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788836685.580973:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8151554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5d9f3bec-9812-4f3e-be22-5440158bfa78:3619:1875730518799104:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788836685.581920:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836685.583824:0:25785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a80462e7200/0xbd163c73757161bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbd163c73757161b5 expref: 23 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836685.583838:0:25785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a80462e7200/0xbd163c73757161bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbd163c73757161b5 expref: 23 pid: 22749 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836685.583849:0:25785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8047445880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25785:1875730518799360:0@lo:104: 00000100:00100000:2.0:1788836685.583900:0:25785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836685.583933:0:25785:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a81538c8f00 going to sleep for 11 seconds 00010000:00010000:2.0:1788836685.583951:0:25785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a817ed15400/0xbd163c7375716383 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd163c737571637c expref: 23 pid: 22748 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836685.583976:0:25785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8181baed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25785:1875730518798720:0@lo:104: 00010000:00010000:2.0:1788836685.583985:0:25785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a80462e7000/0xbd163c7375716209 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd163c7375716202 expref: 22 pid: 22749 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836685.583990:0:25785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8166e96a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25785:1875730518798848:0@lo:104: 00000100:00100000:1.0:1788836685.584044:0:22739:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1788836685.584055:0:22739:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:2.0:1788836685.584704:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518799360 00000100:00100000:2.0:1788836685.584712:0:22739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518799360 00000100:00100000:1.0:1788836685.585145:0:25787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788836685.585156:0:25787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8047447b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5d9f3bec-9812-4f3e-be22-5440158bfa78+4:25785:x1875730518799360:12345-0@lo:104: 00010000:00010000:1.0:1788836685.585170:0:25787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.144@tcp lock: ffff9a8167975800/0xbd163c73757161b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd163c73757161bc expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836685.585270:0:25787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788836685.585275:0:25787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8047447b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5d9f3bec-9812-4f3e-be22-5440158bfa78+4:25785:x1875730518799360:12345-0@lo:104: Request processed in 122us (1374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836685.585279:0:25787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1788836685.585328:0:22744:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788836685.585336:0:22744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.144@tcp lock: ffff9a8167975800/0xbd163c73757161b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd163c73757161bc expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836685.585344:0:22744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8167975800 already unused, calling callback (ffffffffc139ec20) 10000000:00010000:0.0:1788836685.585348:0:22744:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.144@tcp lock: ffff9a8167975800/0xbd163c73757161b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd163c73757161bc expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836685.585355:0:22744:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.144@tcp lock: ffff9a8167975800/0xbd163c73757161b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd163c73757161bc expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788836685.585360:0:22744:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.144@tcp lock: ffff9a8167975800/0xbd163c73757161b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd163c73757161bc expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788836685.585364:0:22744:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788836685.585401:0:22744:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.144@tcp lock: ffff9a8167975800/0xbd163c73757161b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd163c73757161bc expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836685.585405:0:22744:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788836685.585421:0:22744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.144@tcp lock: ffff9a8167975800/0xbd163c73757161b5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd163c73757161bc expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836685.585425:0:22744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.144@tcp lock: ffff9a8167975800/0xbd163c73757161b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd163c73757161bc expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836685.585440:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836685.585442:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788836685.585443:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836685.585453:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8151554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d9f3bec-9812-4f3e-be22-5440158bfa78:3621:1875730518799488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788836685.585498:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836685.585534:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518799488 00000100:00100000:0.0:1788836685.585537:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518799488 00010000:00010000:0.0:1788836685.585560:0:22740:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a80462e7200/0xbd163c73757161bc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd163c73757161b5 expref: 22 pid: 22749 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836685.585589:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788836685.585596:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8151555c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d9f3bec-9812-4f3e-be22-5440158bfa78+22:3621:x1875730518799488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788836685.585608:0:22740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836685.585613:0:22740:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a80462e7200/0xbd163c73757161bc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd163c73757161b5 expref: 22 pid: 22749 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836685.585622:0:22740:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a80462e7200/0xbd163c73757161bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd163c73757161b5 expref: 22 pid: 22749 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836685.585643:0:22740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836685.585663:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8151555c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d9f3bec-9812-4f3e-be22-5440158bfa78+22:3621:x1875730518799488:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836685.585667:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788836685.585694:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8151554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d9f3bec-9812-4f3e-be22-5440158bfa78:3621:1875730518799488:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788836685.585917:0:25785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a80462e7200/0xbd163c73757161bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd163c73757161b5 expref: 21 pid: 22749 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836685.585925:0:25785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8047445880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25785:1875730518799360:0@lo:104: 00000100:00100000:1.0:1788836685.587942:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836685.588060:0:25785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8181baf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25785:1875730518798464:192.168.201.44@tcp:104: 00000100:00100000:3.0:1788836685.588072:0:25785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8181baea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25785:1875730518798592:192.168.201.44@tcp:104: 00000100:00100000:0.0:1788836685.588120:0:25098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511328640 00000100:00100000:0.0:1788836685.588126:0:25098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511328640 00010000:00010000:0.0:1788836685.588158:0:25098:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a817f41b200/0xbd163c737571652e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e547 expref: 13 pid: 22749 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836685.588200:0:25098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 12 00000100:00100000:0.0:1788836685.588211:0:25098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8148619880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ef4c47b-fc99-4862-96ec-0565fed75f8d+13:2408:x1875730511328640:12345-192.168.201.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836685.588222:0:25098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836685.588225:0:25098:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a817f41b200/0xbd163c737571652e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e547 expref: 13 pid: 22749 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836685.588233:0:25098:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a817f41b200/0xbd163c737571652e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e547 expref: 13 pid: 22749 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836685.588244:0:25098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a817f41b200/0xbd163c737571652e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e547 expref: 13 pid: 22749 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836685.588255:0:25098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836685.588300:0:25098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8148619880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ef4c47b-fc99-4862-96ec-0565fed75f8d+12:2408:x1875730511328640:12345-192.168.201.44@tcp:103:ldlm_bl.0 Request processed in 89us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836685.588306:0:25098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 12 00000100:00100000:3.0:1788836685.588541:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836685.588808:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511328768 00000100:00100000:1.0:1788836685.588812:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511328768 00010000:00010000:1.0:1788836685.588826:0:22741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a817f41be00/0xbd163c73757164ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e4d7 expref: 12 pid: 22750 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836685.588842:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 13 00000100:00100000:1.0:1788836685.588857:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8041421450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ef4c47b-fc99-4862-96ec-0565fed75f8d+12:2411:x1875730511328768:12345-192.168.201.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788836685.588862:0:22741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836685.588866:0:22741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a817f41be00/0xbd163c73757164ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e4d7 expref: 12 pid: 22750 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836685.588872:0:22741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a817f41be00/0xbd163c73757164ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e4d7 expref: 12 pid: 22750 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836685.588880:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a817f41be00/0xbd163c73757164ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e4d7 expref: 12 pid: 22750 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836685.588887:0:22741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836685.588907:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8041421450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ef4c47b-fc99-4862-96ec-0565fed75f8d+11:2411:x1875730511328768:12345-192.168.201.44@tcp:103:ldlm_bl.0 Request processed in 51us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836685.588911:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 13 00010000:00010000:3.0:1788836685.589795:0:22738:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788836685.589804:0:22738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a80455a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5d9f3bec-9812-4f3e-be22-5440158bfa78+3:25785:x1875730518798976:12345-0@lo:104: Request processed in 10794us (10826us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836685.589811:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1788836685.589859:0:23912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836685.589873:0:23912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.144@tcp lock: ffff9a80462e7e00/0xbd163c73757161c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbd163c73757161ca expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836685.589879:0:23912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a80462e7e00 already unused, calling callback (ffffffffc139ec20) 10000000:00010000:1.0:1788836685.589882:0:23912:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.144@tcp lock: ffff9a80462e7e00/0xbd163c73757161c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbd163c73757161ca expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836685.589889:0:23912:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.144@tcp lock: ffff9a80462e7e00/0xbd163c73757161c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbd163c73757161ca expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788836685.589893:0:23912:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.144@tcp lock: ffff9a80462e7e00/0xbd163c73757161c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbd163c73757161ca expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836685.589897:0:23912:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788836685.589932:0:23912:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.144@tcp lock: ffff9a80462e7e00/0xbd163c73757161c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd163c73757161ca expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836685.589936:0:23912:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788836685.589958:0:23912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.144@tcp lock: ffff9a80462e7e00/0xbd163c73757161c3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd163c73757161ca expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836685.589963:0:23912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.144@tcp lock: ffff9a80462e7e00/0xbd163c73757161c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbd163c73757161ca expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836685.589975:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836685.589976:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836685.589977:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836685.590017:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8148619880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d9f3bec-9812-4f3e-be22-5440158bfa78:3618:1875730518799616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788836685.590062:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836685.590238:0:25098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518799616 00000100:00100000:1.0:1788836685.590243:0:25098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518799616 00010000:00010000:1.0:1788836685.590260:0:25098:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a817f41a800/0xbd163c73757161ca lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd163c73757161c3 expref: 21 pid: 22749 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836685.590293:0:25098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788836685.590302:0:25098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a80455a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d9f3bec-9812-4f3e-be22-5440158bfa78+21:3618:x1875730518799616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788836685.590313:0:25098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836685.590318:0:25098:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a817f41a800/0xbd163c73757161ca lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbd163c73757161c3 expref: 21 pid: 22749 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836685.590327:0:25098:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a817f41a800/0xbd163c73757161ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbd163c73757161c3 expref: 21 pid: 22749 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836685.590342:0:25098:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a80462e7a00/0xbd163c737571655f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836685.590350:0:25098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a80462e7a00/0xbd163c737571655f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836685.590363:0:25098:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a80462e7a00/0xbd163c737571655f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836685.590369:0:25098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a80462e7a00/0xbd163c737571655f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836685.590383:0:25098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a80462e7a00/0xbd163c737571655f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836685.590387:0:25098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a80462e7a00/0xbd163c737571655f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836685.590390:0:25098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a80462e7a00 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:1.0:1788836685.590393:0:25098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a80462e7a00/0xbd163c737571655f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836685.590403:0:25098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a80462e7a00/0xbd163c737571655f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836685.590410:0:25098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a80462e7a00/0xbd163c737571655f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836685.590417:0:25098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836685.590632:0:25098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a80455a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d9f3bec-9812-4f3e-be22-5440158bfa78+21:3618:x1875730518799616:12345-0@lo:103:ldlm_bl.0 Request processed in 331us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836685.590638:0:25098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1788836685.590929:0:25785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a817f41a800/0xbd163c73757161ca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbd163c73757161c3 expref: 20 pid: 22749 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836685.590942:0:25785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a81412e9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25785:1875730518798976:0@lo:104: 00010000:00010000:0.0:1788836685.590974:0:25785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a80462e7a00/0xbd163c737571655f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836685.590989:0:25785:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a80462e7a00/0xbd163c737571655f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836685.590993:0:25785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a80462e7a00/0xbd163c737571655f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836685.591007:0:25785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a80462e7a00/0xbd163c737571655f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836685.591691:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8148619880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5d9f3bec-9812-4f3e-be22-5440158bfa78:3618:1875730518799616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788836685.671268:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788836685.671291:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a80455a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875730518799744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788836685.671400:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836685.671477:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518799744 00000100:00100000:3.0:1788836685.671484:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518799744 00000100:00100000:3.0:1788836685.671534:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788836685.671544:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a80455a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875730518799744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788836685.671573:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788836685.671618:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a80455a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875730518799744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836685.671625:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788836685.671669:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a80455a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875730518799744:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788836685.671795:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788836685.671802:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788836685.671812:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8151554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875730518799872:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788836685.671838:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836685.671861:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518799872 00000100:00100000:0.0:1788836685.671864:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518799872 00000100:00100000:0.0:1788836685.671887:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788836685.671892:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8151556a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875730518799872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788836685.671902:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788836685.671927:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8151556a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875730518799872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 34us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836685.671932:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1788836685.671946:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788836685.671963:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8151554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875730518799872:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788836685.681573:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8047444000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875730518800384:0@lo:400:kworker.0 00000100:00100000:2.0:1788836685.681701:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836685.681738:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8047445880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875730518800896:0@lo:400:kworker.0 00000100:00100000:2.0:1788836685.681762:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836685.681789:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788836685.681795:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8047446300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875730518800000:0@lo:400:kworker.0 00000100:00100000:2.0:1788836685.681817:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836685.681836:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8047444a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875730518800512:0@lo:400:kworker.0 00000100:00100000:2.0:1788836685.681880:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836685.681901:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f534700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875730518801024:0@lo:400:kworker.0 00000100:00100000:2.0:1788836685.681924:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836685.681970:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518800384 00000100:00100000:2.0:1788836685.681978:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518800384 00000100:00100000:2.0:1788836685.682016:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518800000 00000100:00100000:2.0:1788836685.682037:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518800000 00000100:00100000:2.0:1788836685.682059:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788836685.682067:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f537b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875730518800384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836685.682120:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f537b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875730518800384:12345-0@lo:400:kworker.0 Request processed in 54us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836685.682127:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788836685.682146:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788836685.682151:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f536680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875730518800000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836685.682178:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f536680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875730518800000:12345-0@lo:400:kworker.0 Request processed in 27us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836685.682184:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788836685.682201:0:24288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518800896 00000100:00100000:2.0:1788836685.682204:0:24288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518800896 00000100:00100000:2.0:1788836685.682234:0:24288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518801024 00000100:00100000:2.0:1788836685.682236:0:24288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518801024 00000100:00100000:2.0:1788836685.682253:0:24288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788836685.682260:0:24288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f537480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875730518800896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836685.682287:0:24288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f537480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875730518800896:12345-0@lo:400:kworker.0 Request processed in 29us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836685.682293:0:24288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788836685.682304:0:24288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788836685.682309:0:24288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814865a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875730518801024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836685.682333:0:24288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814865a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875730518801024:12345-0@lo:400:kworker.0 Request processed in 24us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836685.682340:0:24288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788836685.682378:0:24573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518800512 00000100:00100000:2.0:1788836685.682382:0:24573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518800512 00000100:00100000:2.0:1788836685.682419:0:24573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788836685.682426:0:24573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8148659180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875730518800512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836685.682457:0:24573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8148659180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875730518800512:12345-0@lo:400:kworker.0 Request processed in 33us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836685.682486:0:24573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788836685.682534:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8047446300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875730518800000:0@lo:400:kworker.0 00000100:00100000:2.0:1788836685.682546:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8047444a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875730518800512:0@lo:400:kworker.0 00000100:00100000:2.0:1788836685.682555:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f534700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875730518801024:0@lo:400:kworker.0 00000100:00100000:2.0:1788836685.682564:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8047444000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875730518800384:0@lo:400:kworker.0 00010000:00080000:2.0:1788836685.682575:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a8047445880 x1875730518800896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836701 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836685.682585:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8047445880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875730518800896:0@lo:400:kworker.0 00000100:00100000:2.0:1788836685.682617:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8047447800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875730518800256:0@lo:400:kworker.0 00000100:00100000:2.0:1788836685.682672:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836685.682691:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8047446a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875730518800768:0@lo:400:kworker.0 00000100:00100000:2.0:1788836685.682712:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836685.682728:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788836685.682735:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8047446d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875730518800128:0@lo:400:kworker.0 00000100:00100000:2.0:1788836685.682756:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836685.682772:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8047445f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875730518800640:0@lo:400:kworker.0 00000100:00100000:2.0:1788836685.682791:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836685.682806:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f536d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875730518801152:0@lo:400:kworker.0 00000100:00100000:2.0:1788836685.682823:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836685.682849:0:24288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518800256 00000100:00100000:2.0:1788836685.682853:0:24288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518800256 00000100:00100000:2.0:1788836685.682866:0:24288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518800768 00000100:00100000:2.0:1788836685.682868:0:24288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518800768 00000100:00100000:2.0:1788836685.682877:0:24288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518800640 00000100:00100000:2.0:1788836685.682879:0:24288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518800640 00000100:00100000:2.0:1788836685.682887:0:24288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518801152 00000100:00100000:2.0:1788836685.682889:0:24288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518801152 00000100:00100000:2.0:1788836685.682899:0:24288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788836685.682905:0:24288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814865bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875730518800256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836685.682936:0:24288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814865bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875730518800256:12345-0@lo:400:kworker.0 Request processed in 31us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836685.682941:0:24288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788836685.682953:0:24288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788836685.682958:0:24288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814865aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875730518800768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836685.682984:0:24288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814865aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875730518800768:12345-0@lo:400:kworker.0 Request processed in 26us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836685.682989:0:24288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788836685.683000:0:24288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788836685.683005:0:24288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8148658700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875730518800640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836685.683045:0:24288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8148658700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875730518800640:12345-0@lo:400:kworker.0 Request processed in 40us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836685.683051:0:24288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788836685.683062:0:24288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788836685.683067:0:24288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8148658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875730518801152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836685.683090:0:24288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8148658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875730518801152:12345-0@lo:400:kworker.0 Request processed in 23us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836685.683104:0:24288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788836685.683124:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518800128 00000100:00100000:2.0:1788836685.683128:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518800128 00000100:00100000:2.0:1788836685.683152:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788836685.683158:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8148659f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875730518800128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836685.683188:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8148659f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875730518800128:12345-0@lo:400:kworker.0 Request processed in 30us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836685.683193:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788836685.683221:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8047446d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875730518800128:0@lo:400:kworker.0 00000100:00100000:2.0:1788836685.683230:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8047445f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875730518800640:0@lo:400:kworker.0 00010000:00080000:2.0:1788836685.683239:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a817f536d80 x1875730518801152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836701 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788836685.683247:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f536d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875730518801152:0@lo:400:kworker.0 00000100:00100000:2.0:1788836685.683256:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8047447800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875730518800256:0@lo:400:kworker.0 00000100:00100000:2.0:1788836685.683263:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8047446a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875730518800768:0@lo:400:kworker.0 00000100:00080000:2.0:1788836685.683284:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788836685.683289:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788836685.683291:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788836686.503809:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788836687.077673:0:22752:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788836687.077681:0:22752:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a804558d000 from 13 10000000:01000000:2.0:1788836687.077686:0:22752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788836687.077740:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a8048434000/0xbd163c7375716566 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.077752:0:22752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.144@tcp lock: ffff9a8048434000/0xbd163c7375716566 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.077778:0:22752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.144@tcp lock: ffff9a8048434000/0xbd163c7375716566 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836687.077802:0:22752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a814865b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518801280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788836687.077868:0:22752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836687.077919:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a81454e6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836687.078057:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518801280 00000100:00100000:1.0:1788836687.078066:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518801280 00000100:00100000:1.0:1788836687.078172:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788836687.078183:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f416c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+20:22752:x1875730518801280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788836687.078196:0:22749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836687.078209:0:22749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a817f41be00/0xbd163c737571656d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd163c7375716566 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836687.078232:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a817f41be00/0xbd163c737571656d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd163c7375716566 expref: 21 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836687.078242:0:22749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a817f41be00/0xbd163c737571656d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd163c7375716566 expref: 21 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836687.078251:0:22749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a817f41be00, rc 0) 00000100:00100000:1.0:1788836687.078319:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f416c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+21:22752:x1875730518801280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836687.078556:0:22752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a814865b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518801280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788836687.078570:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.144@tcp lock: ffff9a8048434000/0xbd163c7375716566 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c737571656d expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.078579:0:22752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.144@tcp lock: ffff9a8048434000/0xbd163c7375716566 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd163c737571656d expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836687.078639:0:22752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a814865b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518801408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836687.078665:0:22752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836687.078833:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788836687.078876:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a81454e6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836687.081378:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518801408 00000100:00100000:1.0:1788836687.081394:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518801408 00000100:00100000:1.0:1788836687.081451:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788836687.081486:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f417050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+21:22752:x1875730518801408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788836687.081663:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f417050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+21:22752:x1875730518801408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 203us (2997us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836687.081671:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788836687.081886:0:22752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a814865b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518801408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836687.081937:0:22752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a814865b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518801536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836687.081995:0:22752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836687.082037:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a81454e6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836687.082090:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518801536 00000100:00100000:1.0:1788836687.082095:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518801536 00000100:00100000:1.0:1788836687.082123:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788836687.082129:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f417c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+21:22752:x1875730518801536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788836687.082294:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f417c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+21:22752:x1875730518801536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 164us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836687.082301:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788836687.083254:0:22752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a814865b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518801536:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788836687.084823:0:25799:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788836687.085051:0:22752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788836687.085078:0:22752:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788836687.085089:0:22752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a8048434000/0xbd163c7375716566 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c737571656d expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.085185:0:22752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.144@tcp lock: ffff9a8048434000/0xbd163c7375716566 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c737571656d expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836687.085197:0:22752:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788836687.085201:0:22752:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a8180f72800 from 13 10000000:01000000:2.0:1788836687.085204:0:22752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788836687.085238:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a8048434e00/0xbd163c7375716574 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.085247:0:22752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.144@tcp lock: ffff9a8048434e00/0xbd163c7375716574 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.085258:0:22752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.144@tcp lock: ffff9a8048434e00/0xbd163c7375716574 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836687.085285:0:22752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a814865b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518801664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788836687.085762:0:22752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836687.085838:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a81412ed600 going to sleep for 11 seconds 00000100:00100000:0.0:1788836687.085881:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518801664 00000100:00100000:0.0:1788836687.085888:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518801664 00000100:00100000:0.0:1788836687.085973:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788836687.085984:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f415850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+21:22752:x1875730518801664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788836687.085998:0:22748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836687.086022:0:22748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a815158fa00/0xbd163c737571657b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd163c7375716574 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836687.086046:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a815158fa00/0xbd163c737571657b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd163c7375716574 expref: 22 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836687.086066:0:22748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a815158fa00/0xbd163c737571657b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd163c7375716574 expref: 22 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836687.086088:0:22748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a815158fa00, rc 0) 00000100:00100000:0.0:1788836687.086499:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f415850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+22:22752:x1875730518801664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 516us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836687.086506:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788836687.086588:0:22752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a814865b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518801664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788836687.086604:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.144@tcp lock: ffff9a8048434e00/0xbd163c7375716574 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c737571657b expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.086613:0:22752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.144@tcp lock: ffff9a8048434e00/0xbd163c7375716574 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd163c737571657b expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836687.086674:0:22752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a814865b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518801792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836687.086714:0:22752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836687.086925:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a81412ed600 going to sleep for 11 seconds 00000100:00100000:2.0:1788836687.087267:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836687.087284:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518801792 00000100:00100000:1.0:1788836687.087291:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518801792 00000100:00100000:1.0:1788836687.087322:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788836687.087331:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f416450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+22:22752:x1875730518801792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788836687.087501:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f416450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+22:22752:x1875730518801792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 170us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836687.087508:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788836687.087558:0:22752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a814865b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518801792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788836687.087592:0:22752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8148618e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518801920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788836687.087643:0:22752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836687.087662:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8143cef0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836687.087674:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518801920 00000100:00100000:1.0:1788836687.087677:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518801920 00000100:00100000:1.0:1788836687.087868:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788836687.087875:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f416850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+22:22752:x1875730518801920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788836687.087953:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f416850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+22:22752:x1875730518801920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836687.087959:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788836687.087997:0:22752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8148618e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518801920:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788836687.088849:0:25800:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788836687.088913:0:22752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788836687.088937:0:22752:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788836687.088946:0:22752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a8048434e00/0xbd163c7375716574 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c737571657b expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836687.088957:0:22752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.144@tcp lock: ffff9a8048434e00/0xbd163c7375716574 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c737571657b expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788836687.088967:0:22752:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788836687.088970:0:22752:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a80471cd800 from 13 10000000:01000000:1.0:1788836687.088972:0:22752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788836687.088998:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a817f41a800/0xbd163c7375716582 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836687.089017:0:22752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.144@tcp lock: ffff9a817f41a800/0xbd163c7375716582 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836687.089026:0:22752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.144@tcp lock: ffff9a817f41a800/0xbd163c7375716582 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836687.089052:0:22752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8148618e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518802048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788836687.089092:0:22752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836687.089187:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8142aeb3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836687.089206:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518802048 00000100:00100000:1.0:1788836687.089212:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518802048 00000100:00100000:1.0:1788836687.089236:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788836687.089243:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f415050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+22:22752:x1875730518802048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788836687.089253:0:22749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836687.089267:0:22749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a817f41b200/0xbd163c7375716589 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd163c7375716582 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836687.089291:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a817f41b200/0xbd163c7375716589 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd163c7375716582 expref: 23 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836687.089302:0:22749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a817f41b200/0xbd163c7375716589 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd163c7375716582 expref: 23 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836687.089313:0:22749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a817f41b200, rc 0) 00000100:00100000:1.0:1788836687.089423:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f415050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+23:22752:x1875730518802048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836687.089430:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788836687.089494:0:22752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8148618e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518802048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788836687.089508:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.144@tcp lock: ffff9a817f41a800/0xbd163c7375716582 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375716589 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836687.089516:0:22752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.144@tcp lock: ffff9a817f41a800/0xbd163c7375716582 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd163c7375716589 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836687.089571:0:22752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8148618e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518802176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788836687.089598:0:22752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836687.089617:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8179dd80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836687.089628:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518802176 00000100:00100000:1.0:1788836687.089631:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518802176 00000100:00100000:1.0:1788836687.089660:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788836687.089667:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81446a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+23:22752:x1875730518802176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788836687.090091:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81446a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+23:22752:x1875730518802176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 423us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836687.090097:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788836687.090219:0:22752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8148618e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518802176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788836687.090253:0:22752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8151554700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518802304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788836687.090297:0:22752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836687.090338:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8148a00840 going to sleep for 11 seconds 00000100:00100000:3.0:1788836687.090672:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518802304 00000100:00100000:3.0:1788836687.090678:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518802304 00000100:00100000:3.0:1788836687.090786:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788836687.090793:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81446a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+23:22752:x1875730518802304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788836687.090885:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81446a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d9f3bec-9812-4f3e-be22-5440158bfa78+23:22752:x1875730518802304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836687.090891:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788836687.091064:0:22752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8151554700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518802304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788836687.091859:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511328896 00000100:00100000:1.0:1788836687.091866:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511328896 00000100:00100000:1.0:1788836687.091911:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 160 00000100:00100000:1.0:1788836687.091920:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f416050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ef4c47b-fc99-4862-96ec-0565fed75f8d+11:18134:x1875730511328896:12345-192.168.201.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788836687.091933:0:22748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836687.091950:0:22748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a817f41b400/0xbd163c7375716590 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4f244a55304e57f expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836687.091974:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a817f41b400/0xbd163c7375716590 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e57f expref: 12 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836687.091985:0:22748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a817f41b400/0xbd163c7375716590 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e57f expref: 12 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836687.091993:0:22748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a817f41b400, rc 0) 00000100:00100000:1.0:1788836687.092052:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f416050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ef4c47b-fc99-4862-96ec-0565fed75f8d+12:18134:x1875730511328896:12345-192.168.201.44@tcp:101:ll_cfg_requeue.0 Request processed in 133us (4786us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836687.092066:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 160 00000100:00100000:1.0:1788836687.096989:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836687.097216:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511329024 00000100:00100000:2.0:1788836687.097227:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511329024 00000100:00100000:2.0:1788836687.097289:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 161 00000100:00100000:2.0:1788836687.097300:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81446a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ef4c47b-fc99-4862-96ec-0565fed75f8d+12:18134:x1875730511329024:12345-192.168.201.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836687.097776:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81446a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ef4c47b-fc99-4862-96ec-0565fed75f8d+12:18134:x1875730511329024:12345-192.168.201.44@tcp:501:ll_cfg_requeue.0 Request processed in 476us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836687.097785:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 161 00000040:00080000:1.0:1788836687.100520:0:25801:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788836687.100783:0:22752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788836687.100807:0:22752:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788836687.100819:0:22752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a817f41a800/0xbd163c7375716582 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375716589 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.100832:0:22752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.144@tcp lock: ffff9a817f41a800/0xbd163c7375716582 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c7375716589 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788836687.100843:0:22752:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788836687.100846:0:22752:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a8166ee6000 from 13 10000000:01000000:2.0:1788836687.100849:0:22752:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788836687.100888:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a8048435800/0xbd163c7375716597 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.100895:0:22752:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.144@tcp lock: ffff9a8048435800/0xbd163c7375716597 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.100906:0:22752:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.144@tcp lock: ffff9a8048435800/0xbd163c7375716597 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836687.100935:0:22752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a814865a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518802432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788836687.101039:0:22752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836687.101086:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a81546d7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788836687.101418:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518802432 00000100:00100000:1.0:1788836687.101426:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518802432 00000100:00100000:1.0:1788836687.101495:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788836687.101505:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81446a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+23:22752:x1875730518802432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788836687.101518:0:22750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836687.101531:0:22750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a817f41b600/0xbd163c737571659e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbd163c7375716597 expref: -99 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836687.101555:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a817f41b600/0xbd163c737571659e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbd163c7375716597 expref: 24 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836687.101565:0:22750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a817f41b600/0xbd163c737571659e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbd163c7375716597 expref: 24 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836687.101574:0:22750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a817f41b600, rc 0) 00000100:00100000:1.0:1788836687.101635:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81446a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+24:22752:x1875730518802432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836687.101641:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788836687.102027:0:22752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a814865a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518802432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788836687.102044:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.144@tcp lock: ffff9a8048435800/0xbd163c7375716597 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c737571659e expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.102054:0:22752:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.144@tcp lock: ffff9a8048435800/0xbd163c7375716597 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbd163c737571659e expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836687.102128:0:22752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a814865a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518802560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788836687.102159:0:22752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836687.102197:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a81546d7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788836687.102832:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518802560 00000100:00100000:1.0:1788836687.102839:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518802560 00000100:00100000:1.0:1788836687.102880:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788836687.102888:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81446a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+24:22752:x1875730518802560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788836687.103041:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81446a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d9f3bec-9812-4f3e-be22-5440158bfa78+24:22752:x1875730518802560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 153us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836687.103062:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788836687.103137:0:22752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a814865a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518802560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788836687.103175:0:22752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8151554700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518802688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788836687.103229:0:22752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836687.103262:0:22752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a81538c8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788836687.103489:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518802688 00000100:00100000:2.0:1788836687.103494:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518802688 00000100:00100000:2.0:1788836687.103524:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788836687.103531:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81446a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+24:22752:x1875730518802688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836687.103611:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81446a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+24:22752:x1875730518802688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836687.103618:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788836687.103834:0:22752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8151554700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5d9f3bec-9812-4f3e-be22-5440158bfa78:22752:1875730518802688:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788836687.104927:0:25802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788836687.105123:0:22752:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788836687.105146:0:22752:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788836687.105157:0:22752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.144@tcp lock: ffff9a8048435800/0xbd163c7375716597 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c737571659e expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836687.105168:0:22752:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.144@tcp lock: ffff9a8048435800/0xbd163c7375716597 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbd163c737571659e expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836687.110525:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836687.110608:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511329152 00000100:00100000:2.0:1788836687.110619:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511329152 00000100:00100000:2.0:1788836687.110676:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 165 00000100:00100000:2.0:1788836687.110693:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81446a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ef4c47b-fc99-4862-96ec-0565fed75f8d+12:18134:x1875730511329152:12345-192.168.201.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836687.110857:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81446a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ef4c47b-fc99-4862-96ec-0565fed75f8d+12:18134:x1875730511329152:12345-192.168.201.44@tcp:503:ll_cfg_requeue.0 Request processed in 172us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836687.110866:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 165 00000100:00100000:3.0:1788836687.131186:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:0.0:1788836687.131818:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511329280 00000100:00100000:0.0:1788836687.131832:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511329280 00000100:00100000:0.0:1788836687.131891:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 166 00000100:00100000:0.0:1788836687.131901:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81446a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ef4c47b-fc99-4862-96ec-0565fed75f8d+12:18134:x1875730511329280:12345-192.168.201.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788836687.131920:0:22749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836687.131955:0:22749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a815158fc00/0xbd163c73757165a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4f244a55304e586 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836687.131990:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a815158fc00/0xbd163c73757165a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e586 expref: 13 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836687.132013:0:22749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a815158fc00/0xbd163c73757165a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e586 expref: 13 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836687.132024:0:22749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a815158fc00, rc 0) 00000100:00100000:0.0:1788836687.132089:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81446a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ef4c47b-fc99-4862-96ec-0565fed75f8d+13:18134:x1875730511329280:12345-192.168.201.44@tcp:101:ll_cfg_requeue.0 Request processed in 188us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836687.132096:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 166 00000100:00100000:3.0:1788836687.137830:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836687.138129:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511329408 00000100:00100000:1.0:1788836687.138139:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511329408 00000100:00100000:1.0:1788836687.138201:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 167 00000100:00100000:1.0:1788836687.138212:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81446a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ef4c47b-fc99-4862-96ec-0565fed75f8d+13:18134:x1875730511329408:12345-192.168.201.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788836687.138381:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81446a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2ef4c47b-fc99-4862-96ec-0565fed75f8d+13:18134:x1875730511329408:12345-192.168.201.44@tcp:501:ll_cfg_requeue.0 Request processed in 168us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836687.138389:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 167 00000100:00100000:1.0:1788836687.154946:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836687.155561:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511329536 00000100:00100000:2.0:1788836687.155573:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511329536 00000100:00100000:2.0:1788836687.155891:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 168 00000100:00100000:2.0:1788836687.155902:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81446a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ef4c47b-fc99-4862-96ec-0565fed75f8d+13:18134:x1875730511329536:12345-192.168.201.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788836687.156078:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81446a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2ef4c47b-fc99-4862-96ec-0565fed75f8d+13:18134:x1875730511329536:12345-192.168.201.44@tcp:503:ll_cfg_requeue.0 Request processed in 177us (1144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836687.156086:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 168 00010000:00010000:0.0:1788836687.525625:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836687.720499:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8148659880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875730518802816:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788836687.720574:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836687.722511:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518802816 00000100:00100000:2.0:1788836687.722522:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518802816 00000100:00100000:2.0:1788836687.722586:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788836687.722599:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8151554700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875730518802816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788836687.722639:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788836687.722729:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8151554700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875730518802816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 134us (2154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836687.722737:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788836687.722799:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8148659880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875730518802816:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788836687.722911:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788836687.722923:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a80455a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875730518802944:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788836687.722959:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788836687.723889:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788836687.724203:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518802944 00000100:00100000:2.0:1788836687.724211:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518802944 00000100:00100000:2.0:1788836687.724267:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788836687.724275:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8148618a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875730518802944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788836687.724293:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00080000:3.0:1788836687.724516:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788836687.724662:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8148618a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875730518802944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 387us (1701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836687.724670:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788836687.724809:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a80455a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875730518802944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788836687.779625:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:0.0:1788836687.779800:0:24288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511329664 00000100:00100000:0.0:1788836687.779811:0:24288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511329664 00000100:00100000:0.0:1788836687.779892:0:24288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 23 00000100:00100000:0.0:1788836687.779905:0:24288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8148659880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f990379c-347e-4ded-be44-9f2a58ff1508+6:18758:x1875730511329664:12345-192.168.201.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788836687.779929:0:24288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836687.779953:0:24288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f600/0xbd163c73757165ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4f244a55304e58d expref: -99 pid: 24288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836687.780036:0:24288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158ea00/0xbd163c73757165b3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836687.780052:0:24288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158ea00/0xbd163c73757165b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836687.780083:0:24288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158ea00/0xbd163c73757165b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836687.780285:0:24288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c73757165ba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836687.780297:0:24288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c73757165ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836687.780305:0:24288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c73757165ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836687.780659:0:24288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f200/0xbd163c73757165c1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836687.780670:0:24288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f200/0xbd163c73757165c1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836687.780678:0:24288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f200/0xbd163c73757165c1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836687.780711:0:24288:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788836687.780715:0:24288:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788836687.780757:0:24288:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f200/0xbd163c73757165c1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836687.780768:0:24288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158ea00/0xbd163c73757165b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836687.780774:0:24288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158ea00/0xbd163c73757165b3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836687.780792:0:24288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158ea00/0xbd163c73757165b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836687.780798:0:24288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a815158ea00 already unused, calling callback (ffffffffc19ae4f0) 00010000:00010000:0.0:1788836687.780803:0:24288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158ea00/0xbd163c73757165b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836687.780811:0:24288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158ea00/0xbd163c73757165b3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836687.780824:0:24288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8164675c00) 00010000:00010000:0.0:1788836687.780827:0:24288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836687.780832:0:24288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158ea00/0xbd163c73757165b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836687.780839:0:24288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158ea00/0xbd163c73757165b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836687.780854:0:24288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c73757165ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836687.780860:0:24288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c73757165ba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836687.780866:0:24288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c73757165ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836687.780872:0:24288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a815158f000 already unused, calling callback (ffffffffc19ae4f0) 00010000:00010000:0.0:1788836687.780875:0:24288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c73757165ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836687.780890:0:24288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c73757165ba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836687.780899:0:24288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9a8144d12800) 00010000:00010000:0.0:1788836687.780901:0:24288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836687.780904:0:24288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c73757165ba lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836687.780911:0:24288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c73757165ba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836687.780949:0:24288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f600/0xbd163c73757165ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e58d expref: 8 pid: 24288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836687.780965:0:24288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f200/0xbd163c73757165c1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e58d expref: 7 pid: 24288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836687.780973:0:24288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a8144d12a00) 00010000:00010000:0.0:1788836687.780975:0:24288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788836687.780978:0:24288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a815158f200, rc 0) 00000100:00100000:0.0:1788836687.781080:0:24288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8148659880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f990379c-347e-4ded-be44-9f2a58ff1508+7:18758:x1875730511329664:12345-192.168.201.44@tcp:101:lhsmtool_posix.0 Request processed in 1177us (1464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836687.781088:0:24288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 23 00000100:00080000:3.0:1788836687.781135:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788836687.783772:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836687.784673:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511329792 00000100:00100000:2.0:1788836687.784702:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511329792 00000100:00100000:2.0:1788836687.784815:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 5 00000100:00100000:2.0:1788836687.784826:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a80455a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f990379c-347e-4ded-be44-9f2a58ff1508+7:18758:x1875730511329792:12345-192.168.201.44@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788836687.784914:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a80455a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f990379c-347e-4ded-be44-9f2a58ff1508+7:18758:x1875730511329792:12345-192.168.201.44@tcp:900:lhsmtool_posix.0 Request processed in 90us (1151us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836687.784922:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 5 00000100:00100000:1.0:1788836687.810381:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836687.810499:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511330048 00000100:00100000:2.0:1788836687.810522:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511330048 00000100:00100000:2.0:1788836687.810590:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 24 00000100:00100000:2.0:1788836687.810600:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814861b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f990379c-347e-4ded-be44-9f2a58ff1508+7:18758:x1875730511330048:12345-192.168.201.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788836687.810621:0:22754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836687.810644:0:22754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435400/0xbd163c73757165c8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4f244a55304e594 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.810723:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435c00/0xbd163c73757165cf lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.810738:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435c00/0xbd163c73757165cf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.810751:0:22754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435c00/0xbd163c73757165cf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.810769:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434600/0xbd163c73757165d6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.810776:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434600/0xbd163c73757165d6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.810782:0:22754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434600/0xbd163c73757165d6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.810921:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435000/0xbd163c73757165dd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.810930:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435000/0xbd163c73757165dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.810937:0:22754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435000/0xbd163c73757165dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836687.810946:0:22754:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788836687.811422:0:22754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435c00/0xbd163c73757165cf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.811432:0:22754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435c00/0xbd163c73757165cf lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.811439:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435c00/0xbd163c73757165cf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.811445:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8048435c00 already unused, calling callback (ffffffffc19ae4f0) 00010000:00010000:2.0:1788836687.811450:0:22754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435c00/0xbd163c73757165cf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.811456:0:22754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435c00/0xbd163c73757165cf lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.811606:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a8144d12a00) 00010000:00010000:2.0:1788836687.811610:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836687.811616:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435c00/0xbd163c73757165cf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.811633:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435c00/0xbd163c73757165cf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.811649:0:22754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434600/0xbd163c73757165d6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.811654:0:22754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434600/0xbd163c73757165d6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.811660:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434600/0xbd163c73757165d6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.811664:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8048434600 already unused, calling callback (ffffffffc19ae4f0) 00010000:00010000:2.0:1788836687.811666:0:22754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434600/0xbd163c73757165d6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.811672:0:22754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434600/0xbd163c73757165d6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.811680:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a8047362200) 00010000:00010000:2.0:1788836687.811683:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836687.811685:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434600/0xbd163c73757165d6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.811691:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434600/0xbd163c73757165d6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.812974:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435400/0xbd163c73757165c8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e594 expref: 10 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.813032:0:22754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435000/0xbd163c73757165dd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e594 expref: 9 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.813041:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8047362f00) 00010000:00010000:2.0:1788836687.813044:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836687.813046:0:22754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8048435000, rc 0) 00000100:00100000:2.0:1788836687.813132:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814861b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f990379c-347e-4ded-be44-9f2a58ff1508+9:18758:x1875730511330048:12345-192.168.201.44@tcp:101:lhsmtool_posix.0 Request processed in 2532us (2762us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1788836687.813141:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 24 00000100:00100000:0.0:1788836687.828616:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836687.828939:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511330176 00000100:00100000:2.0:1788836687.828949:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511330176 00000100:00100000:2.0:1788836687.829038:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 25 00000100:00100000:2.0:1788836687.829050:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8151555880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f990379c-347e-4ded-be44-9f2a58ff1508+9:18758:x1875730511330176:12345-192.168.201.44@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788836687.829174:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8151555880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f990379c-347e-4ded-be44-9f2a58ff1508+9:18758:x1875730511330176:12345-192.168.201.44@tcp:59:lhsmtool_posix.0 Request processed in 126us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836687.829182:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 25 00000100:00100000:3.0:1788836687.832189:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:0.0:1788836687.841551:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511330304 00000100:00100000:0.0:1788836687.841567:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511330304 00000100:00100000:0.0:1788836687.841741:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 26 00000100:00100000:0.0:1788836687.841756:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a816bd74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f990379c-347e-4ded-be44-9f2a58ff1508+5:18758:x1875730511330304:12345-192.168.201.44@tcp:59:lhsmtool_posix.0 00000100:00080000:3.0:1788836687.858540:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:2.0:1788836687.860632:0:22756:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 18819us 00000040:00080000:1.0:1788836687.861319:0:22791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788836687.886902:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836687.887101:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511330432 00000100:00100000:2.0:1788836687.887112:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511330432 00000100:00100000:2.0:1788836687.887178:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 27 00000100:00100000:2.0:1788836687.887189:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166d88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f990379c-347e-4ded-be44-9f2a58ff1508+9:18764:x1875730511330432:12345-192.168.201.44@tcp:101:lfs.0 00010000:00010000:2.0:1788836687.887213:0:22755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836687.887234:0:22755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435400/0xbd163c73757165eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4f244a55304e59b expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.887321:0:22755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434600/0xbd163c73757165f2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.887346:0:22755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434600/0xbd163c73757165f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.887359:0:22755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434600/0xbd163c73757165f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.887374:0:22755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435c00/0xbd163c73757165f9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.887382:0:22755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435c00/0xbd163c73757165f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.887388:0:22755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435c00/0xbd163c73757165f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.887432:0:22755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434600/0xbd163c73757165f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.887440:0:22755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434600/0xbd163c73757165f2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.887446:0:22755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434600/0xbd163c73757165f2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.887452:0:22755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8048434600 already unused, calling callback (ffffffffc19ae4f0) 00010000:00010000:2.0:1788836687.887457:0:22755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434600/0xbd163c73757165f2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.889733:0:22755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434600/0xbd163c73757165f2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.889758:0:22755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8164675c00) 00010000:00010000:2.0:1788836687.889762:0:22755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836687.889768:0:22755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434600/0xbd163c73757165f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.889776:0:22755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434600/0xbd163c73757165f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.889801:0:22755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435c00/0xbd163c73757165f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.889809:0:22755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435c00/0xbd163c73757165f9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.889817:0:22755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435c00/0xbd163c73757165f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.889823:0:22755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8048435c00 already unused, calling callback (ffffffffc19ae4f0) 00010000:00010000:2.0:1788836687.889827:0:22755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435c00/0xbd163c73757165f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.889833:0:22755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435c00/0xbd163c73757165f9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.889839:0:22755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9a8047362200) 00010000:00010000:2.0:1788836687.889842:0:22755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836687.889845:0:22755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435c00/0xbd163c73757165f9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.889860:0:22755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435c00/0xbd163c73757165f9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.889930:0:22755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435400/0xbd163c73757165eb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e59b expref: 10 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.889943:0:22755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8164675c00) 00010000:00010000:2.0:1788836687.889946:0:22755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836687.889949:0:22755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435400/0xbd163c73757165eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e59b expref: 10 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.889959:0:22755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8048435400, rc 0) 00000100:00100000:2.0:1788836687.890068:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166d88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f990379c-347e-4ded-be44-9f2a58ff1508+9:18764:x1875730511330432:12345-192.168.201.44@tcp:101:lfs.0 Request processed in 2881us (3174us total) trans 0 rc 301/301 00000100:00100000:2.0:1788836687.890078:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 27 00000100:00100000:3.0:1788836687.898386:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836687.898575:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511330560 00000100:00100000:2.0:1788836687.898586:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511330560 00000100:00100000:2.0:1788836687.898641:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 0 00000100:00100000:2.0:1788836687.898653:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f990379c-347e-4ded-be44-9f2a58ff1508+9:18764:x1875730511330560:12345-192.168.201.44@tcp:700:lfs.0 00000100:00100000:2.0:1788836687.898734:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f990379c-347e-4ded-be44-9f2a58ff1508+9:18764:x1875730511330560:12345-192.168.201.44@tcp:700:lfs.0 Request processed in 83us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836687.898741:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 0 00000100:00100000:1.0:1788836687.905152:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836687.912800:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a816bd74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f990379c-347e-4ded-be44-9f2a58ff1508+5:18758:x1875730511330304:12345-192.168.201.44@tcp:59:lhsmtool_posix.0 Request processed in 71038us (80610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836687.912814:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 26 00000100:00100000:2.0:1788836687.912842:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511330816 00000100:00100000:2.0:1788836687.912855:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511330816 00000100:00100000:0.0:1788836687.913150:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 28 00000100:00100000:1.0:1788836687.914810:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814861b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f990379c-347e-4ded-be44-9f2a58ff1508+9:18764:x1875730511330816:12345-192.168.201.44@tcp:36:lfs.0 00010000:00010000:1.0:1788836687.914884:0:22754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836687.914914:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7600/0xbd163c7375716519 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e508 expref: 9 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836687.914935:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8164675c00) 00010000:00010000:1.0:1788836687.914940:0:22754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788836687.915023:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a817f41b000/0xbd163c7375716600 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836687.915040:0:22754:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158e000/0xbd163c7375716558 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e578 expref: 5 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836687.915051:0:22754:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a817f41b000/0xbd163c7375716600 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836687.915091:0:22754:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158e000/0xbd163c7375716558 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e578 expref: 5 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836687.915107:0:22754:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158e000/0xbd163c7375716558 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e578 expref: 5 pid: 22754 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836687.915122:0:22754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8148618e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22754:1875730518803072:192.168.201.44@tcp:104: 00000100:00100000:1.0:1788836687.915211:0:22754:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a81515ba300 going to sleep for 11 seconds 00000100:00100000:2.0:1788836687.927283:0:22754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8148618e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22754:1875730518803072:192.168.201.44@tcp:104: 00010000:00010000:2.0:1788836687.927332:0:22754:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a817f41b000/0xbd163c7375716600 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836687.931078:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:0.0:1788836687.931197:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511330944 00000100:00100000:0.0:1788836687.931209:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511330944 00010000:00010000:0.0:1788836687.931278:0:22740:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158e000/0xbd163c7375716558 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e578 expref: 6 pid: 22754 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836687.931335:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 15 00000100:00100000:0.0:1788836687.931350:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166d8b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:397edcbf-83fc-4215-a82a-1f239b89b4e7+6:2409:x1875730511330944:12345-192.168.201.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836687.931365:0:22740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836687.931373:0:22740:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158e000/0xbd163c7375716558 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e578 expref: 6 pid: 22754 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836687.931387:0:22740:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158e000/0xbd163c7375716558 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e578 expref: 6 pid: 22754 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836687.931414:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158e000/0xbd163c7375716558 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e578 expref: 6 pid: 22754 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836687.931432:0:22740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8164675c00) 00010000:00010000:0.0:1788836687.931437:0:22740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a817f41b000/0xbd163c7375716600 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836687.931447:0:22740:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a817f41b000/0xbd163c7375716600 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836687.931454:0:22740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a817f41b000/0xbd163c7375716600 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836687.931540:0:22740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836687.931597:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166d8b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:397edcbf-83fc-4215-a82a-1f239b89b4e7+5:2409:x1875730511330944:12345-192.168.201.44@tcp:103:ldlm_bl.0 Request processed in 247us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836687.931605:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 15 00010000:00010000:2.0:1788836687.931750:0:22754:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a817f41b000/0xbd163c7375716600 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.931759:0:22754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a817f41b000/0xbd163c7375716600 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.931784:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435400/0xbd163c7375716607 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.931795:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435400/0xbd163c7375716607 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.931804:0:22754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435400/0xbd163c7375716607 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788836687.933037:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788836687.933585:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435c00/0xbd163c737571660e lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.933603:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435c00/0xbd163c737571660e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.933614:0:22754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435c00/0xbd163c737571660e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788836687.933631:0:22754:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000231ebf21 reply state 00000000f09ca0b8 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435c00/0xbd163c737571660e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.933641:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435c00/0xbd163c737571660e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.933655:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a8047362300) 00010000:00010000:2.0:1788836687.933658:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788836687.933662:0:22754:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788836687.933669:0:22754:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788836687.933677:0:22754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a817f41b000/0xbd163c7375716600 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.933683:0:22754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a817f41b000/0xbd163c7375716600 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.933690:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a817f41b000/0xbd163c7375716600 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.933696:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a817f41b000 already unused, calling callback (ffffffffc19ae4f0) 00010000:00010000:2.0:1788836687.933700:0:22754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a817f41b000/0xbd163c7375716600 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.933708:0:22754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a817f41b000/0xbd163c7375716600 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.933719:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8164675c00) 00010000:00010000:2.0:1788836687.933721:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836687.933724:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a817f41b000/0xbd163c7375716600 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.933729:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a817f41b000/0xbd163c7375716600 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788836687.933745:0:22754:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000231ebf21 reply state 00000000f09ca0b8 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435400/0xbd163c7375716607 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.933765:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435400/0xbd163c7375716607 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836687.933771:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9a8047362200) 00010000:00010000:2.0:1788836687.933773:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788836687.933775:0:22754:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788836687.933863:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814861b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f990379c-347e-4ded-be44-9f2a58ff1508+10:18764:x1875730511330816:12345-192.168.201.44@tcp:36:lfs.0 Request processed in 20701us (28720us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1788836687.933872:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 28 00000100:00100000:3.0:1788836688.018409:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836688.018627:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511331072 00000100:00100000:2.0:1788836688.018638:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511331072 00000100:00100000:2.0:1788836688.018815:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 29 00000100:00100000:2.0:1788836688.018829:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8172d94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f990379c-347e-4ded-be44-9f2a58ff1508+10:18772:x1875730511331072:12345-192.168.201.44@tcp:101:lctl.0 00010000:00010000:2.0:1788836688.018861:0:22755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836688.018883:0:22755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434600/0xbd163c7375716615 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4f244a55304e5a2 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.018955:0:22755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435e00/0xbd163c737571661c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.018968:0:22755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435e00/0xbd163c737571661c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.018980:0:22755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435e00/0xbd163c737571661c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836688.019048:0:22755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788836688.019052:0:22755:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788836688.019111:0:22755:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435e00/0xbd163c737571661c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.019137:0:22755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434600/0xbd163c7375716615 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e5a2 expref: 12 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.019155:0:22755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435e00/0xbd163c737571661c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e5a2 expref: 11 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.019174:0:22755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8047362600) 00010000:00010000:2.0:1788836688.019177:0:22755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788836688.019181:0:22755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8048435e00, rc 0) 00000100:00100000:2.0:1788836688.019245:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8172d94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f990379c-347e-4ded-be44-9f2a58ff1508+11:18772:x1875730511331072:12345-192.168.201.44@tcp:101:lctl.0 Request processed in 419us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836688.019252:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 29 00000100:00100000:1.0:1788836688.052028:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836688.053519:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511331200 00000100:00100000:2.0:1788836688.053533:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511331200 00000100:00100000:2.0:1788836688.053611:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 30 00000100:00100000:2.0:1788836688.053622:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8148619880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397edcbf-83fc-4215-a82a-1f239b89b4e7+5:18773:x1875730511331200:12345-192.168.201.44@tcp:101:lfs.0 00010000:00010000:2.0:1788836688.053644:0:22756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836688.053665:0:22756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434600/0xbd163c7375716623 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4f244a55304e5a9 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.053731:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435200/0xbd163c737571662a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.053746:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435200/0xbd163c737571662a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.053759:0:22756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435200/0xbd163c737571662a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836688.053819:0:22756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788836688.053823:0:22756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788836688.053844:0:22756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435200/0xbd163c737571662a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.053869:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434600/0xbd163c7375716623 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e5a9 expref: 7 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.053886:0:22756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435200/0xbd163c737571662a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e5a9 expref: 6 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.053894:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8047362600) 00010000:00010000:2.0:1788836688.053897:0:22756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788836688.053900:0:22756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8048435200, rc 0) 00000100:00100000:2.0:1788836688.053968:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8148619880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397edcbf-83fc-4215-a82a-1f239b89b4e7+6:18773:x1875730511331200:12345-192.168.201.44@tcp:101:lfs.0 Request processed in 348us (1950us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836688.053976:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 30 00000100:00100000:3.0:1788836688.058943:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:0.0:1788836688.059282:0:24288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511331328 00000100:00100000:0.0:1788836688.059296:0:24288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511331328 00000100:00100000:0.0:1788836688.059623:0:24288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 31 00000100:00100000:0.0:1788836688.059635:0:24288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8172d95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397edcbf-83fc-4215-a82a-1f239b89b4e7+6:18773:x1875730511331328:12345-192.168.201.44@tcp:101:lfs.0 00010000:00010000:0.0:1788836688.059659:0:24288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836688.059692:0:24288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158e000/0xbd163c7375716631 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4f244a55304e5b0 expref: -99 pid: 24288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.059762:0:24288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c7375716638 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.059783:0:24288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c7375716638 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.059798:0:24288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c7375716638 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.059812:0:24288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158ea00/0xbd163c737571663f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.059820:0:24288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158ea00/0xbd163c737571663f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.059827:0:24288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158ea00/0xbd163c737571663f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.059927:0:24288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f400/0xbd163c7375716646 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.059937:0:24288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f400/0xbd163c7375716646 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.059944:0:24288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f400/0xbd163c7375716646 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836688.059997:0:24288:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788836688.060001:0:24288:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788836688.060026:0:24288:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f400/0xbd163c7375716646 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.060038:0:24288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c7375716638 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.060045:0:24288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c7375716638 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.060051:0:24288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c7375716638 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.060058:0:24288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a815158f000 already unused, calling callback (ffffffffc19ae4f0) 00010000:00010000:0.0:1788836688.060063:0:24288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c7375716638 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.060070:0:24288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c7375716638 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.060082:0:24288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8047362600) 00010000:00010000:0.0:1788836688.060093:0:24288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836688.060099:0:24288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c7375716638 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.060106:0:24288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c7375716638 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.060121:0:24288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158ea00/0xbd163c737571663f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.060127:0:24288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158ea00/0xbd163c737571663f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.060133:0:24288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158ea00/0xbd163c737571663f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.060138:0:24288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a815158ea00 already unused, calling callback (ffffffffc19ae4f0) 00010000:00010000:0.0:1788836688.060140:0:24288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158ea00/0xbd163c737571663f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.060146:0:24288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158ea00/0xbd163c737571663f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.060154:0:24288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9a8047362200) 00010000:00010000:0.0:1788836688.060157:0:24288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836688.060171:0:24288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158ea00/0xbd163c737571663f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.060177:0:24288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158ea00/0xbd163c737571663f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.060203:0:24288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158e000/0xbd163c7375716631 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e5b0 expref: 8 pid: 24288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.060230:0:24288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f400/0xbd163c7375716646 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e5b0 expref: 7 pid: 24288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.060238:0:24288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a8047362300) 00010000:00010000:0.0:1788836688.060240:0:24288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788836688.060243:0:24288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a815158f400, rc 0) 00000100:00100000:0.0:1788836688.060312:0:24288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8172d95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397edcbf-83fc-4215-a82a-1f239b89b4e7+7:18773:x1875730511331328:12345-192.168.201.44@tcp:101:lfs.0 Request processed in 679us (1380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836688.060320:0:24288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 31 00000100:00100000:3.0:1788836688.064825:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836688.065893:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511331456 00000100:00100000:2.0:1788836688.065906:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511331456 00000100:00100000:2.0:1788836688.066001:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 6 00000100:00100000:2.0:1788836688.066013:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a804724c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:397edcbf-83fc-4215-a82a-1f239b89b4e7+5:18773:x1875730511331456:12345-192.168.201.44@tcp:900:lfs.0 00000100:00100000:2.0:1788836688.066169:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a804724c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:397edcbf-83fc-4215-a82a-1f239b89b4e7+5:18773:x1875730511331456:12345-192.168.201.44@tcp:900:lfs.0 Request processed in 151us (1349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836688.066178:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 6 00000100:00080000:3.0:1788836688.066354:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788836688.081895:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836688.082319:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511331712 00000100:00100000:2.0:1788836688.082340:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511331712 00000100:00100000:2.0:1788836688.082427:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 32 00000100:00100000:2.0:1788836688.082438:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8148618e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397edcbf-83fc-4215-a82a-1f239b89b4e7+7:18773:x1875730511331712:12345-192.168.201.44@tcp:101:lfs.0 00010000:00010000:2.0:1788836688.082481:0:22754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836688.082503:0:22754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434600/0xbd163c737571664d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4f244a55304e5b7 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836688.082785:0:22754:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788836688.082905:0:22754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434600/0xbd163c737571664d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e5b7 expref: 9 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.082920:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8047362600) 00010000:00010000:2.0:1788836688.082923:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788836688.082927:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434600/0xbd163c737571664d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e5b7 expref: 9 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.082942:0:22754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8048434600, rc 0) 00000100:00100000:2.0:1788836688.083023:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8148618e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:397edcbf-83fc-4215-a82a-1f239b89b4e7+8:18773:x1875730511331712:12345-192.168.201.44@tcp:101:lfs.0 Request processed in 587us (1139us total) trans 12884901891 rc 301/301 00000100:00100000:2.0:1788836688.083031:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 32 00000100:00100000:1.0:1788836688.087329:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836688.087674:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511331968 00000100:00100000:2.0:1788836688.087684:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511331968 00000100:00100000:2.0:1788836688.087746:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 33 00000100:00100000:2.0:1788836688.087757:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81485dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397edcbf-83fc-4215-a82a-1f239b89b4e7+8:18773:x1875730511331968:12345-192.168.201.44@tcp:36:lfs.0 00010000:00010000:2.0:1788836688.087822:0:22755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836688.087859:0:22755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f400/0xbd163c7375716646 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e5b0 expref: 8 pid: 24288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.087890:0:22755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a8047362300) 00010000:00010000:2.0:1788836688.087894:0:22755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788836688.087919:0:22755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434800/0xbd163c737571665b lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.087931:0:22755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434800/0xbd163c737571665b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.087941:0:22755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434800/0xbd163c737571665b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788836688.088178:0:22755:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000011321a29 reply state 00000000704cb0e5 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434800/0xbd163c737571665b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.088192:0:22755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434800/0xbd163c737571665b lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.088197:0:22755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a8047362300) 00010000:00010000:2.0:1788836688.088199:0:22755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1788836688.088202:0:22755:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788836688.088209:0:22755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788836688.088303:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81485dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397edcbf-83fc-4215-a82a-1f239b89b4e7+9:18773:x1875730511331968:12345-192.168.201.44@tcp:36:lfs.0 Request processed in 548us (985us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1788836688.088310:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 33 00000100:00100000:3.0:1788836688.103809:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836688.104147:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511332224 00000100:00100000:1.0:1788836688.104158:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511332224 00000100:00100000:1.0:1788836688.104244:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 2 00000100:00100000:1.0:1788836688.104255:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a804724c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:397edcbf-83fc-4215-a82a-1f239b89b4e7+9:18773:x1875730511332224:12345-192.168.201.44@tcp:35:lfs.0 00000100:00100000:1.0:1788836688.104562:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a804724c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:397edcbf-83fc-4215-a82a-1f239b89b4e7+10:18773:x1875730511332224:12345-192.168.201.44@tcp:35:lfs.0 Request processed in 307us (762us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1788836688.104570:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 2 00000100:00100000:3.0:1788836688.108205:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:0.0:1788836688.108418:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511332480 00000100:00100000:0.0:1788836688.108430:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511332480 00000100:00100000:0.0:1788836688.108544:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 34 00000100:00100000:0.0:1788836688.108555:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8048e76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397edcbf-83fc-4215-a82a-1f239b89b4e7+10:18773:x1875730511332480:12345-192.168.201.44@tcp:101:lfs.0 00010000:00010000:0.0:1788836688.108578:0:22756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836688.108597:0:22756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158e000/0xbd163c7375716662 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4f244a55304e5be expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.108670:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158ea00/0xbd163c7375716669 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.108686:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158ea00/0xbd163c7375716669 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.108696:0:22756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158ea00/0xbd163c7375716669 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.108705:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c7375716670 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.108725:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c7375716670 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.108731:0:22756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c7375716670 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836688.108829:0:22756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788836688.109154:0:22756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158ea00/0xbd163c7375716669 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.109163:0:22756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158ea00/0xbd163c7375716669 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.109170:0:22756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158ea00/0xbd163c7375716669 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.109177:0:22756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a815158ea00 already unused, calling callback (ffffffffc19ae4f0) 00010000:00010000:0.0:1788836688.109186:0:22756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158ea00/0xbd163c7375716669 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.109194:0:22756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158ea00/0xbd163c7375716669 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.109206:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8047362600) 00010000:00010000:0.0:1788836688.109209:0:22756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836688.109213:0:22756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158ea00/0xbd163c7375716669 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.109219:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158ea00/0xbd163c7375716669 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.109566:0:22756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c7375716670 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.109573:0:22756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c7375716670 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.109579:0:22756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c7375716670 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.109585:0:22756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a815158f000 already unused, calling callback (ffffffffc19ae4f0) 00010000:00010000:0.0:1788836688.109588:0:22756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c7375716670 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.109595:0:22756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c7375716670 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.109605:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9a8047362200) 00010000:00010000:0.0:1788836688.109607:0:22756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836688.109610:0:22756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c7375716670 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.109615:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c7375716670 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.109656:0:22756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158e000/0xbd163c7375716662 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e5be expref: 12 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.109666:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8047362600) 00010000:00010000:0.0:1788836688.109669:0:22756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788836688.109680:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158e000/0xbd163c7375716662 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e5be expref: 12 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.109690:0:22756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a815158e000, rc 0) 00000100:00100000:0.0:1788836688.109767:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8048e76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:397edcbf-83fc-4215-a82a-1f239b89b4e7+11:18773:x1875730511332480:12345-192.168.201.44@tcp:101:lfs.0 Request processed in 1213us (1573us total) trans 12884901894 rc 301/301 00000100:00100000:0.0:1788836688.109774:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 34 00000100:00100000:2.0:1788836688.119134:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:0.0:1788836688.129020:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511332608 00000100:00100000:0.0:1788836688.129037:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511332608 00000100:00100000:0.0:1788836688.129115:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 35 00000100:00100000:0.0:1788836688.129125:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8148658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397edcbf-83fc-4215-a82a-1f239b89b4e7+11:18773:x1875730511332608:12345-192.168.201.44@tcp:101:lfs.0 00010000:00010000:0.0:1788836688.129150:0:22755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836688.129171:0:22755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158e000/0xbd163c737571667e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4f244a55304e5c5 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.129278:0:22755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c7375716685 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.129293:0:22755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c7375716685 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.129304:0:22755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c7375716685 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836688.129342:0:22755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788836688.129346:0:22755:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788836688.129366:0:22755:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c7375716685 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.129393:0:22755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158e000/0xbd163c737571667e lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e5c5 expref: 13 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.129429:0:22755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c7375716685 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e5c5 expref: 12 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.129438:0:22755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a8047362300) 00010000:00010000:0.0:1788836688.129442:0:22755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788836688.129445:0:22755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a815158f000, rc 0) 00000100:00100000:0.0:1788836688.130650:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8148658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397edcbf-83fc-4215-a82a-1f239b89b4e7+12:18773:x1875730511332608:12345-192.168.201.44@tcp:101:lfs.0 Request processed in 1517us (11518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836688.130663:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 35 00000100:00100000:3.0:1788836688.150504:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836688.150925:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511332736 00000100:00100000:1.0:1788836688.150937:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511332736 00000100:00100000:1.0:1788836688.151004:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 3 00000100:00100000:1.0:1788836688.151015:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8048e74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:397edcbf-83fc-4215-a82a-1f239b89b4e7+12:18773:x1875730511332736:12345-192.168.201.44@tcp:37:lfs.0 00000100:00100000:2.0:1788836688.157621:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8048e74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:397edcbf-83fc-4215-a82a-1f239b89b4e7+12:18773:x1875730511332736:12345-192.168.201.44@tcp:37:lfs.0 Request processed in 6589us (7142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836688.157635:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 3 00000100:00100000:2.0:1788836688.163022:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836688.167558:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511332992 00000100:00100000:3.0:1788836688.167576:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511332992 00000100:00100000:3.0:1788836688.167660:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 4 00000100:00100000:3.0:1788836688.167673:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8041094850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:397edcbf-83fc-4215-a82a-1f239b89b4e7+12:18773:x1875730511332992:12345-192.168.201.44@tcp:35:lfs.0 00000100:00100000:3.0:1788836688.167927:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8041094850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:397edcbf-83fc-4215-a82a-1f239b89b4e7+13:18773:x1875730511332992:12345-192.168.201.44@tcp:35:lfs.0 Request processed in 256us (4916us total) trans 12884901895 rc 0/0 00000100:00100000:3.0:1788836688.167935:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 4 00000100:00100000:3.0:1788836688.287377:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836688.287489:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511333120 00000100:00100000:2.0:1788836688.287499:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511333120 00000100:00100000:2.0:1788836688.287571:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 36 00000100:00100000:2.0:1788836688.287582:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8048e74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f990379c-347e-4ded-be44-9f2a58ff1508+11:18779:x1875730511333120:12345-192.168.201.44@tcp:101:bash.0 00010000:00010000:2.0:1788836688.287606:0:22754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836688.287627:0:22754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434c00/0xbd163c737571668c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4f244a55304e5cc expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.287704:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434a00/0xbd163c7375716693 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.287719:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434a00/0xbd163c7375716693 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.287731:0:22754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434a00/0xbd163c7375716693 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.287743:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434200/0xbd163c737571669a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.287750:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434200/0xbd163c737571669a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.287757:0:22754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434200/0xbd163c737571669a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.287834:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435600/0xbd163c73757166a1 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.287842:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435600/0xbd163c73757166a1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.287869:0:22754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435600/0xbd163c73757166a1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836688.287904:0:22754:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788836688.287908:0:22754:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788836688.287962:0:22754:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435600/0xbd163c73757166a1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.287975:0:22754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434a00/0xbd163c7375716693 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.288022:0:22754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434a00/0xbd163c7375716693 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.288030:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434a00/0xbd163c7375716693 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.288036:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8048434a00 already unused, calling callback (ffffffffc19ae4f0) 00010000:00010000:2.0:1788836688.288040:0:22754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434a00/0xbd163c7375716693 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.288047:0:22754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434a00/0xbd163c7375716693 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.288061:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8047362600) 00010000:00010000:2.0:1788836688.288064:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836688.288068:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434a00/0xbd163c7375716693 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.288074:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434a00/0xbd163c7375716693 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.288102:0:22754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434200/0xbd163c737571669a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.288109:0:22754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434200/0xbd163c737571669a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.288114:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434200/0xbd163c737571669a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.288119:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8048434200 already unused, calling callback (ffffffffc19ae4f0) 00010000:00010000:2.0:1788836688.288121:0:22754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434200/0xbd163c737571669a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.288127:0:22754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434200/0xbd163c737571669a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.288135:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9a8047362200) 00010000:00010000:2.0:1788836688.288137:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788836688.288140:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434200/0xbd163c737571669a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.288145:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434200/0xbd163c737571669a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.288170:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434c00/0xbd163c737571668c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e5cc expref: 13 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.288182:0:22754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435600/0xbd163c73757166a1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e5cc expref: 12 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.288200:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a8047362300) 00010000:00010000:2.0:1788836688.288202:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788836688.288204:0:22754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8048435600, rc 0) 00000100:00100000:2.0:1788836688.288277:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8048e74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f990379c-347e-4ded-be44-9f2a58ff1508+12:18779:x1875730511333120:12345-192.168.201.44@tcp:101:bash.0 Request processed in 696us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836688.288285:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 36 00000100:00100000:1.0:1788836688.292239:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836688.292421:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511333248 00000100:00100000:2.0:1788836688.292431:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511333248 00000100:00100000:2.0:1788836688.292537:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 7 00000100:00100000:2.0:1788836688.292548:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81485dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f990379c-347e-4ded-be44-9f2a58ff1508+5:18779:x1875730511333248:12345-192.168.201.44@tcp:900:bash.0 00000100:00100000:2.0:1788836688.292639:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81485dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f990379c-347e-4ded-be44-9f2a58ff1508+5:18779:x1875730511333248:12345-192.168.201.44@tcp:900:bash.0 Request processed in 92us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836688.292648:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 7 00000100:00100000:1.0:1788836688.306953:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836688.307786:0:24288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511333504 00000100:00100000:3.0:1788836688.307798:0:24288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511333504 00000100:00100000:3.0:1788836688.307870:0:24288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 37 00000100:00100000:3.0:1788836688.307880:0:24288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81485ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f990379c-347e-4ded-be44-9f2a58ff1508+12:18779:x1875730511333504:12345-192.168.201.44@tcp:101:bash.0 00010000:00010000:3.0:1788836688.307901:0:24288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836688.307921:0:24288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7800/0xbd163c73757166a8 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4f244a55304e5d3 expref: -99 pid: 24288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836688.308048:0:24288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e6000/0xbd163c73757166af lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836688.308065:0:24288:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c7375716685 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e5c5 expref: 12 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836688.308096:0:24288:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e6000/0xbd163c73757166af lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836688.308134:0:24288:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c7375716685 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e5c5 expref: 12 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836688.308149:0:24288:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c7375716685 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e5c5 expref: 12 pid: 22755 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836688.308305:0:24288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8048e76680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24288:1875730518803200:192.168.201.44@tcp:104: 00000100:00100000:3.0:1788836688.308559:0:24288:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a815869d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836688.314398:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836688.314550:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511333632 00000100:00100000:2.0:1788836688.314561:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511333632 00010000:00010000:2.0:1788836688.314607:0:22741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c7375716685 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e5c5 expref: 13 pid: 22755 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836688.314648:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 16 00000100:00100000:2.0:1788836688.314659:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81485dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:397edcbf-83fc-4215-a82a-1f239b89b4e7+13:2409:x1875730511333632:12345-192.168.201.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836688.314673:0:22741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836688.314679:0:22741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c7375716685 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e5c5 expref: 13 pid: 22755 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.314692:0:22741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c7375716685 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e5c5 expref: 13 pid: 22755 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.314730:0:22741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a8047362300) 00010000:00010000:2.0:1788836688.314736:0:22741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e6000/0xbd163c73757166af lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.314745:0:22741:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e6000/0xbd163c73757166af lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.314753:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e6000/0xbd163c73757166af lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.314769:0:22741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836688.314828:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81485dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:397edcbf-83fc-4215-a82a-1f239b89b4e7+13:2409:x1875730511333632:12345-192.168.201.44@tcp:103:ldlm_bl.0 Request processed in 170us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836688.314835:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 16 00010000:00010000:0.0:1788836688.322562:0:24288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c7375716685 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e5c5 expref: 12 pid: 22755 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836688.322598:0:24288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8048e76680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24288:1875730518803200:192.168.201.44@tcp:104: 00010000:00010000:0.0:1788836688.322626:0:24288:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e6000/0xbd163c73757166af lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.322639:0:24288:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e6000/0xbd163c73757166af lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.322644:0:24288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e6000/0xbd163c73757166af lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.322718:0:24288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158e000/0xbd163c73757166b6 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.322732:0:24288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158e000/0xbd163c73757166b6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.322762:0:24288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158e000/0xbd163c73757166b6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.323899:0:24288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158ea00/0xbd163c73757166bd lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.323913:0:24288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158ea00/0xbd163c73757166bd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.323922:0:24288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158ea00/0xbd163c73757166bd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836688.323933:0:24288:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788836688.323958:0:24288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e6000/0xbd163c73757166af lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.323964:0:24288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e6000/0xbd163c73757166af lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.323971:0:24288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e6000/0xbd163c73757166af lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.323977:0:24288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a80462e6000 already unused, calling callback (ffffffffc19ae4f0) 00010000:00010000:0.0:1788836688.323994:0:24288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e6000/0xbd163c73757166af lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.324002:0:24288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e6000/0xbd163c73757166af lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.324015:0:24288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a8047362300) 00010000:00010000:0.0:1788836688.324018:0:24288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788836688.324033:0:24288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e6000/0xbd163c73757166af lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.324040:0:24288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e6000/0xbd163c73757166af lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788836688.324054:0:24288:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ab27d15b reply state 000000000e0464f7 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158e000/0xbd163c73757166b6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.324065:0:24288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158e000/0xbd163c73757166b6 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.324071:0:24288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9a8144d12800) 00010000:00010000:0.0:1788836688.324073:0:24288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788836688.324076:0:24288:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788836688.324117:0:24288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7800/0xbd163c73757166a8 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e5d3 expref: 15 pid: 24288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.324132:0:24288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158ea00/0xbd163c73757166bd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e5d3 expref: 14 pid: 24288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.324139:0:24288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a8144d12400) 00010000:00010000:0.0:1788836688.324141:0:24288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788836688.324143:0:24288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a815158ea00, rc 0) 00000100:00100000:0.0:1788836688.324736:0:24288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81485ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f990379c-347e-4ded-be44-9f2a58ff1508+15:18779:x1875730511333504:12345-192.168.201.44@tcp:101:bash.0 Request processed in 16855us (17791us total) trans 12884901896 rc 0/0 00000100:00100000:0.0:1788836688.324747:0:24288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 37 00000100:00100000:1.0:1788836688.338955:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836688.339096:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511333760 00000100:00100000:2.0:1788836688.339107:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511333760 00000100:00100000:2.0:1788836688.339191:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 38 00000100:00100000:2.0:1788836688.339203:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81485dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f990379c-347e-4ded-be44-9f2a58ff1508+15:18779:x1875730511333760:12345-192.168.201.44@tcp:101:bash.0 00010000:00010000:2.0:1788836688.339234:0:22754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836688.339262:0:22754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434c00/0xbd163c73757166cb lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4f244a55304e5da expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.339352:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434200/0xbd163c73757166d2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.339367:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434200/0xbd163c73757166d2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.339379:0:22754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434200/0xbd163c73757166d2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836688.339442:0:22754:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788836688.339446:0:22754:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788836688.339492:0:22754:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434200/0xbd163c73757166d2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.339503:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434200/0xbd163c73757166d2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.339530:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434c00/0xbd163c73757166cb lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e5da expref: 17 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.339549:0:22754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434200/0xbd163c73757166d2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e5da expref: 16 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.339558:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a8144d12400) 00010000:00010000:2.0:1788836688.339561:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788836688.339565:0:22754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8048434200, rc 0) 00000100:00100000:2.0:1788836688.339633:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81485dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f990379c-347e-4ded-be44-9f2a58ff1508+16:18779:x1875730511333760:12345-192.168.201.44@tcp:101:bash.0 Request processed in 431us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836688.339641:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 38 00000100:00100000:3.0:1788836688.343199:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836688.343299:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511334016 00000100:00100000:1.0:1788836688.343312:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511334016 00000100:00100000:1.0:1788836688.343381:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 5 00000100:00100000:1.0:1788836688.343392:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8048e75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f990379c-347e-4ded-be44-9f2a58ff1508+16:18779:x1875730511334016:12345-192.168.201.44@tcp:35:bash.0 00000100:00100000:1.0:1788836688.353631:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8048e75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f990379c-347e-4ded-be44-9f2a58ff1508+17:18779:x1875730511334016:12345-192.168.201.44@tcp:35:bash.0 Request processed in 573us (775us total) trans 12884901897 rc 0/0 00000100:00100000:1.0:1788836688.353661:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 5 00000100:00100000:3.0:1788836688.476131:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:0.0:1788836688.476394:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511334272 00000100:00100000:0.0:1788836688.476405:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511334272 00000100:00100000:0.0:1788836688.476510:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 39 00000100:00100000:0.0:1788836688.476521:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8048e74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f990379c-347e-4ded-be44-9f2a58ff1508+17:18789:x1875730511334272:12345-192.168.201.44@tcp:101:lfs.0 00010000:00010000:0.0:1788836688.476561:0:22755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836688.476579:0:22755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c73757166d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4f244a55304e5e1 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836688.476687:0:22755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788836688.476786:0:22755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c73757166d9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e5e1 expref: 19 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.476801:0:22755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8047362600) 00010000:00010000:0.0:1788836688.476804:0:22755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788836688.476809:0:22755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c73757166d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e5e1 expref: 19 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.476823:0:22755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a815158f000, rc 0) 00000100:00100000:0.0:1788836688.476888:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8048e74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f990379c-347e-4ded-be44-9f2a58ff1508+18:18789:x1875730511334272:12345-192.168.201.44@tcp:101:lfs.0 Request processed in 369us (768us total) trans 12884901898 rc 301/301 00000100:00100000:0.0:1788836688.476895:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 39 00000100:00100000:3.0:1788836688.497645:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836688.498007:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511334528 00000100:00100000:2.0:1788836688.498016:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511334528 00000100:00100000:2.0:1788836688.498086:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 6 00000100:00100000:2.0:1788836688.498097:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8048e76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f990379c-347e-4ded-be44-9f2a58ff1508+18:18789:x1875730511334528:12345-192.168.201.44@tcp:35:lfs.0 00000100:00100000:2.0:1788836688.498372:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8048e76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f990379c-347e-4ded-be44-9f2a58ff1508+19:18789:x1875730511334528:12345-192.168.201.44@tcp:35:lfs.0 Request processed in 276us (735us total) trans 12884901899 rc 0/0 00000100:00100000:2.0:1788836688.498380:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 6 00010000:00010000:1.0:1788836688.549821:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788836688.597314:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836688.597508:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511334784 00000100:00100000:2.0:1788836688.597518:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511334784 00000100:00100000:2.0:1788836688.597584:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 40 00000100:00100000:2.0:1788836688.597595:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81485df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f990379c-347e-4ded-be44-9f2a58ff1508+19:18792:x1875730511334784:12345-192.168.201.44@tcp:101:lfs.0 00010000:00010000:2.0:1788836688.597624:0:22754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836688.597658:0:22754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434c00/0xbd163c73757166e7 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4f244a55304e5e8 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.597780:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434a00/0xbd163c73757166ee lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.597797:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434a00/0xbd163c73757166ee lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.597811:0:22754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434a00/0xbd163c73757166ee lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836688.597824:0:22754:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788836688.597941:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434c00/0xbd163c73757166e7 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e5e8 expref: 22 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.597960:0:22754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434a00/0xbd163c73757166ee lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e5e8 expref: 21 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836688.597969:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a8144d12400) 00010000:00010000:2.0:1788836688.597972:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788836688.597985:0:22754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8048434a00, rc 0) 00000100:00100000:2.0:1788836688.598052:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81485df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f990379c-347e-4ded-be44-9f2a58ff1508+21:18792:x1875730511334784:12345-192.168.201.44@tcp:101:lfs.0 Request processed in 458us (748us total) trans 12884901900 rc 0/0 00000100:00100000:2.0:1788836688.598074:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 40 00000100:00100000:3.0:1788836688.603239:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:0.0:1788836688.603366:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511334912 00000100:00100000:0.0:1788836688.603376:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511334912 00000100:00100000:0.0:1788836688.603489:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 41 00000100:00100000:0.0:1788836688.603515:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8048e76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f990379c-347e-4ded-be44-9f2a58ff1508+21:18792:x1875730511334912:12345-192.168.201.44@tcp:54:lfs.0 00010000:00010000:0.0:1788836688.603584:0:22755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c73757166fc lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.603603:0:22755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c73757166fc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.603616:0:22755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c73757166fc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.603675:0:22755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c73757166fc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.603682:0:22755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c73757166fc lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.603687:0:22755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c73757166fc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.603693:0:22755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a815158f000 already unused, calling callback (ffffffffc19ae4f0) 00010000:00010000:0.0:1788836688.603697:0:22755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c73757166fc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.603704:0:22755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c73757166fc lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.603716:0:22755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a8144d12400) 00010000:00010000:0.0:1788836688.603718:0:22755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788836688.603723:0:22755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c73757166fc lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.603728:0:22755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f000/0xbd163c73757166fc lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836688.603806:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8048e76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f990379c-347e-4ded-be44-9f2a58ff1508+21:18792:x1875730511334912:12345-192.168.201.44@tcp:54:lfs.0 Request processed in 306us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836688.603815:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 41 00000100:00100000:3.0:1788836688.607830:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836688.607923:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511335168 00000100:00100000:2.0:1788836688.607933:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511335168 00000100:00100000:2.0:1788836688.608005:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 7 00000100:00100000:2.0:1788836688.608015:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166d89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f990379c-347e-4ded-be44-9f2a58ff1508+21:18792:x1875730511335168:12345-192.168.201.44@tcp:35:lfs.0 00000100:00100000:2.0:1788836688.608250:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166d89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f990379c-347e-4ded-be44-9f2a58ff1508+22:18792:x1875730511335168:12345-192.168.201.44@tcp:35:lfs.0 Request processed in 236us (428us total) trans 12884901901 rc 0/0 00000100:00100000:2.0:1788836688.608259:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 7 00000040:00080000:1.0:1788836688.615014:0:23516:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788836688.618888:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:0.0:1788836688.619197:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511335296 00000100:00100000:0.0:1788836688.619208:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511335296 00000100:00100000:0.0:1788836688.619277:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 0 00000100:00100000:0.0:1788836688.619303:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81485de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f990379c-347e-4ded-be44-9f2a58ff1508+22:2408:x1875730511335296:12345-192.168.201.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836688.619330:0:22740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836688.619355:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434a00/0xbd163c73757166ee lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e5e8 expref: 22 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836688.619375:0:22740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a8144d12400) 00010000:00010000:0.0:1788836688.619379:0:22740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836688.619436:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81485de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f990379c-347e-4ded-be44-9f2a58ff1508+21:2408:x1875730511335296:12345-192.168.201.44@tcp:103:ldlm_bl.0 Request processed in 135us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836688.619444:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 0 00000100:00100000:0.0:1788836688.741832:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788836688.741861:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a814861bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875730518803328:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788836688.741945:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836688.742175:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788836688.742186:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a814865b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875730518803456:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788836688.742233:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836688.742270:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518803328 00000100:00100000:2.0:1788836688.742278:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518803328 00000100:00100000:2.0:1788836688.742335:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518803456 00000100:00100000:2.0:1788836688.742338:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518803456 00000100:00100000:2.0:1788836688.742354:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788836688.742361:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8151557b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875730518803328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788836688.742396:0:22760:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788836688.742437:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8151557b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875730518803328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836688.742444:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788836688.742629:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788836688.742639:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814865ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875730518803456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788836688.742657:0:22760:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788836688.742707:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814865ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875730518803456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836688.742725:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788836688.742783:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a814865b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875730518803456:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788836688.742812:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a814861bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875730518803328:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788836688.752123:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:0.0:1788836688.752256:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511335424 00000100:00100000:0.0:1788836688.752267:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511335424 00000100:00100000:0.0:1788836688.752339:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 169 00000100:00100000:0.0:1788836688.752351:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81446a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ef4c47b-fc99-4862-96ec-0565fed75f8d+13:2408:x1875730511335424:12345-192.168.201.44@tcp:400:kworker.0 00000100:00100000:0.0:1788836688.762245:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81446a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ef4c47b-fc99-4862-96ec-0565fed75f8d+13:2408:x1875730511335424:12345-192.168.201.44@tcp:400:kworker.0 Request processed in 9883us (10120us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836688.762265:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 169 00000100:00100000:3.0:1788836688.762655:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836688.762791:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836688.762807:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836688.762820:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836688.762837:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836688.762851:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836688.762868:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836688.762889:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511335936 00000100:00100000:3.0:1788836688.762896:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511335936 00000100:00100000:3.0:1788836688.762946:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511335552 00000100:00100000:3.0:1788836688.762949:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511335552 00000100:00100000:3.0:1788836688.762958:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511336064 00000100:00100000:3.0:1788836688.762959:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511336064 00000100:00100000:3.0:1788836688.763004:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 67 00000100:00100000:3.0:1788836688.763014:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a804724c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397edcbf-83fc-4215-a82a-1f239b89b4e7+12:2408:x1875730511335936:12345-192.168.201.44@tcp:400:kworker.0 00000100:00100000:1.0:1788836688.763740:0:24288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 68 00000100:00100000:1.0:1788836688.763750:0:24288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f50dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f990379c-347e-4ded-be44-9f2a58ff1508+5:2408:x1875730511335552:12345-192.168.201.44@tcp:400:kworker.0 00000100:00100000:1.0:1788836688.763790:0:24288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f50dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f990379c-347e-4ded-be44-9f2a58ff1508+5:2408:x1875730511335552:12345-192.168.201.44@tcp:400:kworker.0 Request processed in 42us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836688.763797:0:24288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 68 00000100:00100000:1.0:1788836688.763814:0:24288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 69 00000100:00100000:1.0:1788836688.763820:0:24288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f50c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397edcbf-83fc-4215-a82a-1f239b89b4e7+5:2408:x1875730511336064:12345-192.168.201.44@tcp:400:kworker.0 00000100:00100000:1.0:1788836688.763838:0:24288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f50c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397edcbf-83fc-4215-a82a-1f239b89b4e7+5:2408:x1875730511336064:12345-192.168.201.44@tcp:400:kworker.0 Request processed in 18us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836688.763844:0:24288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 69 00000100:00100000:3.0:1788836688.765855:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a804724c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:397edcbf-83fc-4215-a82a-1f239b89b4e7+12:2408:x1875730511335936:12345-192.168.201.44@tcp:400:kworker.0 Request processed in 2832us (3053us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836688.765869:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 67 00000100:00100000:2.0:1788836688.766566:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511335680 00000100:00100000:2.0:1788836688.766576:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511335680 00000100:00100000:2.0:1788836688.766628:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511336192 00000100:00100000:2.0:1788836688.766632:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511336192 00000100:00100000:2.0:1788836688.766644:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511335808 00000100:00100000:2.0:1788836688.766647:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511335808 00000100:00100000:2.0:1788836688.766657:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511336320 00000100:00100000:2.0:1788836688.766660:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511336320 00000100:00100000:2.0:1788836688.766678:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 22 00000100:00100000:2.0:1788836688.766687:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814861bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f990379c-347e-4ded-be44-9f2a58ff1508+5:2408:x1875730511335680:12345-192.168.201.44@tcp:400:kworker.0 00000100:00100000:2.0:1788836688.766763:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814861bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f990379c-347e-4ded-be44-9f2a58ff1508+5:2408:x1875730511335680:12345-192.168.201.44@tcp:400:kworker.0 Request processed in 77us (4108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836688.766770:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 22 00000100:00100000:2.0:1788836688.766785:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 23 00000100:00100000:2.0:1788836688.766791:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f50d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:397edcbf-83fc-4215-a82a-1f239b89b4e7+5:2408:x1875730511336192:12345-192.168.201.44@tcp:400:kworker.0 00000100:00100000:2.0:1788836688.766816:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f50d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:397edcbf-83fc-4215-a82a-1f239b89b4e7+5:2408:x1875730511336192:12345-192.168.201.44@tcp:400:kworker.0 Request processed in 25us (4007us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836688.766822:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 23 00000100:00100000:2.0:1788836688.766832:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 24 00000100:00100000:2.0:1788836688.766838:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f50df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f990379c-347e-4ded-be44-9f2a58ff1508+5:2408:x1875730511335808:12345-192.168.201.44@tcp:400:kworker.0 00000100:00100000:2.0:1788836688.766888:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f50df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f990379c-347e-4ded-be44-9f2a58ff1508+5:2408:x1875730511335808:12345-192.168.201.44@tcp:400:kworker.0 Request processed in 50us (4049us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836688.766900:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 24 00000100:00100000:2.0:1788836688.766911:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 25 00000100:00100000:2.0:1788836688.766917:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f50ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:397edcbf-83fc-4215-a82a-1f239b89b4e7+5:2408:x1875730511336320:12345-192.168.201.44@tcp:400:kworker.0 00000100:00100000:2.0:1788836688.766936:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f50ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:397edcbf-83fc-4215-a82a-1f239b89b4e7+5:2408:x1875730511336320:12345-192.168.201.44@tcp:400:kworker.0 Request processed in 21us (4068us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836688.766941:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 25 00000100:00080000:3.0:1788836688.767628:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788836688.767634:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788836689.069768:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836689.071576:0:24288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511336576 00000100:00100000:3.0:1788836689.071590:0:24288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511336576 00000100:00100000:3.0:1788836689.071798:0:24288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 42 00000100:00100000:3.0:1788836689.071812:0:24288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81485dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f990379c-347e-4ded-be44-9f2a58ff1508+21:18823:x1875730511336576:12345-192.168.201.44@tcp:101:cat.0 00010000:00010000:3.0:1788836689.071836:0:24288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836689.071853:0:24288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7400/0xbd163c7375716703 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4f244a55304e5ef expref: -99 pid: 24288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836689.071954:0:24288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7c00/0xbd163c737571670a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836689.071980:0:24288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7c00/0xbd163c737571670a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788836689.072160:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788836689.073408:0:24288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7c00/0xbd163c737571670a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836689.074705:0:24288:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788836689.075330:0:24288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7400/0xbd163c7375716703 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e5ef expref: 24 pid: 24288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836689.075356:0:24288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7c00/0xbd163c737571670a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e5ef expref: 23 pid: 24288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836689.075366:0:24288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a8144d12400) 00010000:00010000:2.0:1788836689.075368:0:24288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788836689.075372:0:24288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a80462e7c00, rc 0) 00000100:00100000:2.0:1788836689.075747:0:24288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81485dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f990379c-347e-4ded-be44-9f2a58ff1508+23:18823:x1875730511336576:12345-192.168.201.44@tcp:101:cat.0 Request processed in 3936us (5984us total) trans 12884901902 rc 0/0 00000100:00100000:2.0:1788836689.075757:0:24288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 42 00000100:00100000:1.0:1788836689.082741:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836689.082897:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511336832 00000100:00100000:2.0:1788836689.082907:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511336832 00000100:00100000:2.0:1788836689.083001:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 8 00000100:00100000:2.0:1788836689.083021:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81485dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f990379c-347e-4ded-be44-9f2a58ff1508+23:18823:x1875730511336832:12345-192.168.201.44@tcp:35:cat.0 00000100:00100000:2.0:1788836689.083340:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81485dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f990379c-347e-4ded-be44-9f2a58ff1508+24:18823:x1875730511336832:12345-192.168.201.44@tcp:35:cat.0 Request processed in 328us (608us total) trans 12884901903 rc 0/0 00000100:00100000:2.0:1788836689.083366:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 8 00000100:00100000:3.0:1788836689.085139:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836689.092923:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511336960 00000100:00100000:2.0:1788836689.092938:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511336960 00000100:00100000:2.0:1788836689.093282:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 1 00000100:00100000:2.0:1788836689.093292:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f50e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f990379c-347e-4ded-be44-9f2a58ff1508+24:2409:x1875730511336960:12345-192.168.201.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836689.093308:0:22741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836689.093344:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7c00/0xbd163c737571670a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e5ef expref: 24 pid: 24288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836689.093364:0:22741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a8144d12400) 00010000:00010000:2.0:1788836689.093368:0:22741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836689.093445:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f50e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f990379c-347e-4ded-be44-9f2a58ff1508+23:2409:x1875730511336960:12345-192.168.201.44@tcp:103:ldlm_bl.0 Request processed in 149us (8309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836689.093452:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 1 00000100:00100000:0.0:1788836689.203659:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836689.211733:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511337216 00000100:00100000:3.0:1788836689.211747:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511337216 00000100:00100000:3.0:1788836689.211826:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 43 00000100:00100000:3.0:1788836689.211836:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8151554a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f990379c-347e-4ded-be44-9f2a58ff1508+23:18829:x1875730511337216:12345-192.168.201.44@tcp:101:dd.0 00010000:00010000:3.0:1788836689.211861:0:22755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836689.211880:0:22755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7400/0xbd163c7375716718 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4f244a55304e5f6 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836689.211988:0:22755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7800/0xbd163c737571671f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836689.212003:0:22755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7800/0xbd163c737571671f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836689.212071:0:22755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7800/0xbd163c737571671f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836689.212083:0:22755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788836689.212672:0:22755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7400/0xbd163c7375716718 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e5f6 expref: 26 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836689.212692:0:22755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7800/0xbd163c737571671f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e5f6 expref: 25 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836689.212701:0:22755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a8144d12400) 00010000:00010000:3.0:1788836689.212704:0:22755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788836689.212707:0:22755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a80462e7800, rc 0) 00000100:00100000:3.0:1788836689.212823:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8151554a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f990379c-347e-4ded-be44-9f2a58ff1508+25:18829:x1875730511337216:12345-192.168.201.44@tcp:101:dd.0 Request processed in 988us (9174us total) trans 12884901904 rc 0/0 00000100:00100000:3.0:1788836689.212847:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 43 00000100:00100000:1.0:1788836689.229288:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836689.229356:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:0.0:1788836689.229478:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511337344 00000100:00100000:0.0:1788836689.229498:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511337344 00000100:00100000:0.0:1788836689.229570:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 44 00000100:00100000:0.0:1788836689.229582:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81485df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f990379c-347e-4ded-be44-9f2a58ff1508+25:18829:x1875730511337344:12345-192.168.201.44@tcp:101:dd.0 00010000:00010000:0.0:1788836689.229609:0:22756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836689.229642:0:22756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158ec00/0xbd163c737571672d lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4f244a55304e5fd expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836689.229679:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f800/0xbd163c7375716734 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836689.229694:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f800/0xbd163c7375716734 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836689.229706:0:22756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f800/0xbd163c7375716734 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836689.229823:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158ec00/0xbd163c737571672d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e5fd expref: 27 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836689.229843:0:22756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f800/0xbd163c7375716734 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e5fd expref: 26 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836689.229852:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a8144d12400) 00010000:00010000:0.0:1788836689.229855:0:22756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788836689.229858:0:22756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a815158f800, rc 0) 00000100:00100000:0.0:1788836689.229921:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81485df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f990379c-347e-4ded-be44-9f2a58ff1508+26:18829:x1875730511337344:12345-192.168.201.44@tcp:101:dd.0 Request processed in 341us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836689.229929:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 44 00000100:00100000:3.0:1788836689.233543:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511337472 00000100:00100000:3.0:1788836689.233560:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511337472 00000100:00100000:0.0:1788836689.234040:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 2 00000100:00100000:0.0:1788836689.234051:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81485ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f990379c-347e-4ded-be44-9f2a58ff1508+26:2408:x1875730511337472:12345-192.168.201.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836689.234066:0:22742:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836689.234089:0:22742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7800/0xbd163c737571671f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e5f6 expref: 26 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836689.234128:0:22742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a8144d12400) 00010000:00010000:0.0:1788836689.234132:0:22742:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836689.234205:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81485ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f990379c-347e-4ded-be44-9f2a58ff1508+25:2408:x1875730511337472:12345-192.168.201.44@tcp:103:ldlm_bl.0 Request processed in 156us (4848us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836689.234213:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 2 00000100:00100000:0.0:1788836689.235861:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836689.235936:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511337728 00000100:00100000:2.0:1788836689.235945:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511337728 00000100:00100000:2.0:1788836689.236016:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 45 00000100:00100000:2.0:1788836689.236027:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8151557100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f990379c-347e-4ded-be44-9f2a58ff1508+25:18829:x1875730511337728:12345-192.168.201.44@tcp:36:dd.0 00010000:00010000:2.0:1788836689.236080:0:22754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836689.236104:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434200/0xbd163c73757166d2 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e5da expref: 25 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836689.236120:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a8144d12400) 00010000:00010000:2.0:1788836689.236124:0:22754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788836689.236672:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434c00/0xbd163c737571673b lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836689.236704:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434c00/0xbd163c737571673b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836689.236715:0:22754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434c00/0xbd163c737571673b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788836689.236763:0:22754:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:2.0:1788836689.236786:0:22754:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000231467e9 reply state 00000000329e82c0 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434c00/0xbd163c737571673b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836689.236798:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434c00/0xbd163c737571673b lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836689.236805:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a8144d12400) 00010000:00010000:2.0:1788836689.236808:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788836689.236811:0:22754:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788836689.236905:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8151557100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f990379c-347e-4ded-be44-9f2a58ff1508+27:18829:x1875730511337728:12345-192.168.201.44@tcp:36:dd.0 Request processed in 880us (1052us total) trans 12884901906 rc 0/0 00000100:00100000:2.0:1788836689.236912:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 45 00000020:00080000:2.0:1788836689.236917:0:22754:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788836689.387415:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836689.387650:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511337984 00000100:00100000:2.0:1788836689.387662:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511337984 00000100:00100000:3.0:1788836689.387791:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 9 00000100:00100000:3.0:1788836689.387804:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81485dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f990379c-347e-4ded-be44-9f2a58ff1508+27:18829:x1875730511337984:12345-192.168.201.44@tcp:35:dd.0 00000100:00100000:3.0:1788836689.388172:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81485dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f990379c-347e-4ded-be44-9f2a58ff1508+28:18829:x1875730511337984:12345-192.168.201.44@tcp:35:dd.0 Request processed in 369us (775us total) trans 12884901907 rc 0/0 00000100:00100000:3.0:1788836689.388180:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 9 00010000:00010000:1.0:1788836689.574572:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788836689.638876:0:23516:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788836689.684576:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836689.684684:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511338112 00000100:00100000:1.0:1788836689.684694:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511338112 00000100:00100000:1.0:1788836689.684768:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 46 00000100:00100000:1.0:1788836689.684779:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8151555180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f990379c-347e-4ded-be44-9f2a58ff1508+28:18843:x1875730511338112:12345-192.168.201.44@tcp:101:stat.0 00010000:00010000:1.0:1788836689.684807:0:22756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836689.684830:0:22756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a817f41aa00/0xbd163c7375716742 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4f244a55304e604 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836689.684899:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a817f41b000/0xbd163c7375716749 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836689.684913:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a817f41b000/0xbd163c7375716749 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836689.684939:0:22756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a817f41b000/0xbd163c7375716749 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836689.684953:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15400/0xbd163c7375716750 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836689.684973:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15400/0xbd163c7375716750 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836689.684980:0:22756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15400/0xbd163c7375716750 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836689.685088:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15200/0xbd163c7375716757 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836689.685097:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15200/0xbd163c7375716757 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836689.685103:0:22756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15200/0xbd163c7375716757 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836689.685143:0:22756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788836689.685148:0:22756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788836689.685186:0:22756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15200/0xbd163c7375716757 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836689.685200:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15200/0xbd163c7375716757 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836689.685208:0:22756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a817f41b000/0xbd163c7375716749 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836689.685223:0:22756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a817f41b000/0xbd163c7375716749 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836689.685229:0:22756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a817f41b000/0xbd163c7375716749 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836689.685235:0:22756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a817f41b000 already unused, calling callback (ffffffffc19ae4f0) 00010000:00010000:1.0:1788836689.685238:0:22756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a817f41b000/0xbd163c7375716749 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836689.685246:0:22756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a817f41b000/0xbd163c7375716749 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836689.685258:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a8047362300) 00010000:00010000:1.0:1788836689.685261:0:22756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836689.685266:0:22756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a817f41b000/0xbd163c7375716749 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836689.685272:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a817f41b000/0xbd163c7375716749 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836689.685286:0:22756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15400/0xbd163c7375716750 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836689.685292:0:22756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15400/0xbd163c7375716750 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836689.685297:0:22756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15400/0xbd163c7375716750 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836689.685302:0:22756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a817ed15400 already unused, calling callback (ffffffffc19ae4f0) 00010000:00010000:1.0:1788836689.685311:0:22756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15400/0xbd163c7375716750 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836689.685318:0:22756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15400/0xbd163c7375716750 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836689.685325:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9a8144d12800) 00010000:00010000:1.0:1788836689.685328:0:22756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836689.685332:0:22756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15400/0xbd163c7375716750 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836689.685337:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15400/0xbd163c7375716750 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836689.685367:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a817f41aa00/0xbd163c7375716742 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e604 expref: 30 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836689.685381:0:22756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15200/0xbd163c7375716757 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e604 expref: 29 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836689.685388:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a8144d12400) 00010000:00010000:1.0:1788836689.685390:0:22756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788836689.685392:0:22756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a817ed15200, rc 0) 00000100:00100000:1.0:1788836689.685509:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8151555180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f990379c-347e-4ded-be44-9f2a58ff1508+29:18843:x1875730511338112:12345-192.168.201.44@tcp:101:stat.0 Request processed in 685us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836689.685517:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 46 00000100:00100000:0.0:1788836689.754210:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836689.754323:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511338368 00000100:00100000:3.0:1788836689.754334:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511338368 00000100:00100000:3.0:1788836689.754412:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 47 00000100:00100000:3.0:1788836689.754424:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8151556680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f990379c-347e-4ded-be44-9f2a58ff1508+29:18849:x1875730511338368:12345-192.168.201.44@tcp:36:truncate.0 00010000:00010000:3.0:1788836689.754553:0:22754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836689.754583:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15200/0xbd163c7375716757 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e604 expref: 29 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836689.754604:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a8144d12400) 00010000:00010000:3.0:1788836689.754609:0:22754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788836689.754786:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7400/0xbd163c737571675e lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836689.754802:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7400/0xbd163c737571675e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836689.754811:0:22754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7400/0xbd163c737571675e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788836689.754865:0:22754:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901908 00000004:00010000:3.0:1788836689.754891:0:22754:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002a7f7de0 reply state 0000000004ae435a transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7400/0xbd163c737571675e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836689.754904:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7400/0xbd163c737571675e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836689.754911:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a8144d12400) 00010000:00010000:3.0:1788836689.754913:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788836689.754916:0:22754:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788836689.757384:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8151556680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f990379c-347e-4ded-be44-9f2a58ff1508+31:18849:x1875730511338368:12345-192.168.201.44@tcp:36:truncate.0 Request processed in 2950us (3172us total) trans 12884901909 rc 0/0 00000100:00100000:3.0:1788836689.757619:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 47 00000020:00080000:3.0:1788836689.757629:0:22754:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788836689.937029:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836689.937318:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511338496 00000100:00100000:1.0:1788836689.937329:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511338496 00000100:00100000:1.0:1788836689.937499:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 48 00000100:00100000:1.0:1788836689.937512:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f50f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f990379c-347e-4ded-be44-9f2a58ff1508+31:18863:x1875730511338496:12345-192.168.201.44@tcp:101:stat.0 00010000:00010000:1.0:1788836689.937552:0:22756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836689.937571:0:22756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15400/0xbd163c7375716765 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4f244a55304e60b expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836689.937633:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed14600/0xbd163c737571676c lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836689.937649:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed14600/0xbd163c737571676c lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836689.937662:0:22756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed14600/0xbd163c737571676c lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836689.937674:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15a00/0xbd163c7375716773 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836689.937681:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15a00/0xbd163c7375716773 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836689.937688:0:22756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15a00/0xbd163c7375716773 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836689.937760:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15800/0xbd163c737571677a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836689.937770:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15800/0xbd163c737571677a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836689.937777:0:22756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15800/0xbd163c737571677a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836689.937833:0:22756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00000004:00200000:1.0:1788836689.937844:0:22756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788836689.937866:0:22756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15800/0xbd163c737571677a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836689.937878:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15800/0xbd163c737571677a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836689.937886:0:22756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed14600/0xbd163c737571676c lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836689.937892:0:22756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed14600/0xbd163c737571676c lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836689.937899:0:22756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed14600/0xbd163c737571676c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836689.937905:0:22756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a817ed14600 already unused, calling callback (ffffffffc19ae4f0) 00010000:00010000:1.0:1788836689.937910:0:22756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed14600/0xbd163c737571676c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836689.937918:0:22756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed14600/0xbd163c737571676c lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836689.937929:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a8047362300) 00010000:00010000:1.0:1788836689.937932:0:22756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836689.937936:0:22756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed14600/0xbd163c737571676c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836689.937943:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed14600/0xbd163c737571676c lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836689.937973:0:22756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15a00/0xbd163c7375716773 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836689.937990:0:22756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15a00/0xbd163c7375716773 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836689.937996:0:22756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15a00/0xbd163c7375716773 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836689.938002:0:22756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a817ed15a00 already unused, calling callback (ffffffffc19ae4f0) 00010000:00010000:1.0:1788836689.938006:0:22756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15a00/0xbd163c7375716773 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836689.938012:0:22756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15a00/0xbd163c7375716773 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836689.938020:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9a8144d12800) 00010000:00010000:1.0:1788836689.938023:0:22756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836689.938026:0:22756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15a00/0xbd163c7375716773 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836689.938043:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15a00/0xbd163c7375716773 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836689.938081:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15400/0xbd163c7375716765 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e60b expref: 33 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836689.938095:0:22756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15800/0xbd163c737571677a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e60b expref: 32 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836689.938102:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a8144d12400) 00010000:00010000:1.0:1788836689.938104:0:22756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788836689.938115:0:22756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a817ed15800, rc 0) 00000100:00100000:1.0:1788836689.938182:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f50f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f990379c-347e-4ded-be44-9f2a58ff1508+32:18863:x1875730511338496:12345-192.168.201.44@tcp:101:stat.0 Request processed in 672us (1163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836689.938189:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 48 00000100:00100000:3.0:1788836690.052159:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836690.052329:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511338752 00000100:00100000:2.0:1788836690.052339:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511338752 00000100:00100000:2.0:1788836690.052408:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 49 00000100:00100000:2.0:1788836690.052419:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f50ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f990379c-347e-4ded-be44-9f2a58ff1508+32:18873:x1875730511338752:12345-192.168.201.44@tcp:101:lfs.0 00010000:00010000:2.0:1788836690.052441:0:22754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836690.052504:0:22754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434400/0xbd163c7375716781 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4f244a55304e612 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836690.052637:0:22754:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788836690.052741:0:22754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434400/0xbd163c7375716781 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e612 expref: 34 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836690.052755:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8047362600) 00010000:00010000:2.0:1788836690.052758:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788836690.052763:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434400/0xbd163c7375716781 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e612 expref: 34 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836690.052775:0:22754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8048434400, rc 0) 00000100:00100000:2.0:1788836690.052834:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f50ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f990379c-347e-4ded-be44-9f2a58ff1508+33:18873:x1875730511338752:12345-192.168.201.44@tcp:101:lfs.0 Request processed in 417us (684us total) trans 12884901910 rc 301/301 00000100:00100000:2.0:1788836690.052841:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 49 00000100:00100000:0.0:1788836690.057559:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836690.057641:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511339008 00000100:00100000:3.0:1788836690.057651:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511339008 00000100:00100000:3.0:1788836690.057699:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 10 00000100:00100000:3.0:1788836690.057708:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8041095450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f990379c-347e-4ded-be44-9f2a58ff1508+33:18873:x1875730511339008:12345-192.168.201.44@tcp:35:lfs.0 00000100:00100000:3.0:1788836690.057934:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8041095450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f990379c-347e-4ded-be44-9f2a58ff1508+34:18873:x1875730511339008:12345-192.168.201.44@tcp:35:lfs.0 Request processed in 226us (384us total) trans 12884901911 rc 0/0 00000100:00100000:3.0:1788836690.057940:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 10 00000100:00100000:1.0:1788836690.219528:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836690.219690:0:24288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511339264 00000100:00100000:2.0:1788836690.219701:0:24288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511339264 00000100:00100000:2.0:1788836690.219770:0:24288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 50 00000100:00100000:2.0:1788836690.219780:0:24288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81485df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f990379c-347e-4ded-be44-9f2a58ff1508+34:18879:x1875730511339264:12345-192.168.201.44@tcp:101:bash.0 00010000:00010000:2.0:1788836690.219810:0:24288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836690.219833:0:24288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434400/0xbd163c737571678f lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4f244a55304e619 expref: -99 pid: 24288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836690.220004:0:24288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434200/0xbd163c7375716796 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836690.220019:0:24288:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158ea00/0xbd163c73757166bd lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e5d3 expref: 35 pid: 24288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836690.220048:0:24288:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15800/0xbd163c737571677a lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e60b expref: 35 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836690.220057:0:24288:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434200/0xbd163c7375716796 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836690.220094:0:24288:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15800/0xbd163c737571677a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e60b expref: 35 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836690.220108:0:24288:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15800/0xbd163c737571677a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e60b expref: 35 pid: 22756 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836690.220122:0:24288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a814865b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24288:1875730518803584:192.168.201.44@tcp:104: 00010000:00010000:2.0:1788836690.220220:0:24288:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158ea00/0xbd163c73757166bd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e5d3 expref: 35 pid: 24288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836690.220229:0:24288:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158ea00/0xbd163c73757166bd lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e5d3 expref: 35 pid: 24288 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836690.220239:0:24288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8148659500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24288:1875730518803712:192.168.201.44@tcp:104: 00000100:00100000:2.0:1788836690.220263:0:24288:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a81646f2000 going to sleep for 11 seconds 00000100:00100000:2.0:1788836690.226378:0:24288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a814865b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24288:1875730518803584:192.168.201.44@tcp:104: 00000100:00100000:2.0:1788836690.226399:0:24288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8148659500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24288:1875730518803712:192.168.201.44@tcp:104: 00010000:00010000:2.0:1788836690.226431:0:24288:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434200/0xbd163c7375716796 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836690.228879:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836690.229010:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:0.0:1788836690.233715:0:25098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511339392 00000100:00100000:0.0:1788836690.233731:0:25098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511339392 00010000:00010000:0.0:1788836690.233783:0:25098:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15800/0xbd163c737571677a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e60b expref: 36 pid: 22756 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836690.233825:0:25098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511339520 00000100:00100000:0.0:1788836690.233828:0:25098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511339520 00010000:00010000:0.0:1788836690.233842:0:25098:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158ea00/0xbd163c73757166bd lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e5d3 expref: 37 pid: 24288 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836690.233886:0:25098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 17 00000100:00100000:0.0:1788836690.233897:0:25098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8041421850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f990379c-347e-4ded-be44-9f2a58ff1508+37:2408:x1875730511339392:12345-192.168.201.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836690.233913:0:25098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836690.233920:0:25098:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15800/0xbd163c737571677a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e60b expref: 37 pid: 22756 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836690.233932:0:25098:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15800/0xbd163c737571677a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e60b expref: 37 pid: 22756 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836690.233981:0:25098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15800/0xbd163c737571677a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e60b expref: 37 pid: 22756 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836690.234012:0:25098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a8144d12400) 00010000:00010000:0.0:1788836690.234017:0:25098:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434200/0xbd163c7375716796 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836690.234026:0:25098:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434200/0xbd163c7375716796 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836690.234031:0:25098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836690.234094:0:25098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8041421850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f990379c-347e-4ded-be44-9f2a58ff1508+36:2408:x1875730511339392:12345-192.168.201.44@tcp:103:ldlm_bl.0 Request processed in 198us (5222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836690.234101:0:25098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 17 00000100:00100000:0.0:1788836690.234149:0:25098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 18 00000100:00100000:0.0:1788836690.234157:0:25098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81485ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f990379c-347e-4ded-be44-9f2a58ff1508+35:2408:x1875730511339520:12345-192.168.201.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836690.234165:0:25098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836690.234170:0:25098:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158ea00/0xbd163c73757166bd lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e5d3 expref: 35 pid: 24288 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836690.234179:0:25098:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158ea00/0xbd163c73757166bd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e5d3 expref: 35 pid: 24288 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836690.234191:0:25098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158ea00/0xbd163c73757166bd lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e5d3 expref: 35 pid: 24288 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836690.234212:0:25098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a8144d12400) 00010000:00010000:0.0:1788836690.234215:0:25098:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434200/0xbd163c7375716796 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836690.234221:0:25098:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434200/0xbd163c7375716796 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836690.234228:0:25098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434200/0xbd163c7375716796 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836690.234251:0:25098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836690.234271:0:25098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81485ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f990379c-347e-4ded-be44-9f2a58ff1508+34:2408:x1875730511339520:12345-192.168.201.44@tcp:103:ldlm_bl.0 Request processed in 115us (5261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836690.234277:0:25098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 18 00010000:00010000:2.0:1788836690.235655:0:24288:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434200/0xbd163c7375716796 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836690.235670:0:24288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434200/0xbd163c7375716796 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788836690.235690:0:24288:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00010000:00010000:2.0:1788836690.235829:0:24288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434400/0xbd163c737571678f lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e619 expref: 35 pid: 24288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836690.235847:0:24288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434200/0xbd163c7375716796 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e619 expref: 34 pid: 24288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836690.235854:0:24288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a8144d12400) 00010000:00010000:2.0:1788836690.235857:0:24288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788836690.235859:0:24288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8048434200, rc 0) 00000100:00100000:2.0:1788836690.235929:0:24288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81485df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f990379c-347e-4ded-be44-9f2a58ff1508+34:18879:x1875730511339264:12345-192.168.201.44@tcp:101:bash.0 Request processed in 16150us (16411us total) trans 12884901912 rc 0/0 00000100:00100000:2.0:1788836690.235937:0:24288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 50 00000100:00100000:1.0:1788836690.246087:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836690.246981:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511339776 00000100:00100000:2.0:1788836690.246994:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511339776 00000100:00100000:2.0:1788836690.247061:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 51 00000100:00100000:2.0:1788836690.247071:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81485dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f990379c-347e-4ded-be44-9f2a58ff1508+34:18879:x1875730511339776:12345-192.168.201.44@tcp:36:bash.0 00010000:00010000:2.0:1788836690.247515:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434400/0xbd163c73757167a4 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836690.247532:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434400/0xbd163c73757167a4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836690.247558:0:22754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434400/0xbd163c73757167a4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788836690.247605:0:22754:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000004:00010000:2.0:1788836690.247628:0:22754:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000377f9cd3 reply state 00000000d75f5d36 transno 12884901914 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434400/0xbd163c73757167a4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836690.247640:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434400/0xbd163c73757167a4 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836690.247648:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a8144d12400) 00010000:00010000:2.0:1788836690.247651:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788836690.247654:0:22754:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788836690.247757:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81485dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f990379c-347e-4ded-be44-9f2a58ff1508+37:18879:x1875730511339776:12345-192.168.201.44@tcp:36:bash.0 Request processed in 686us (1678us total) trans 12884901914 rc 0/0 00000100:00100000:2.0:1788836690.247764:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 51 00000020:00080000:2.0:1788836690.247770:0:22754:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788836690.251820:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836690.251922:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511339904 00000100:00100000:1.0:1788836690.251931:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511339904 00000100:00100000:1.0:1788836690.252007:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 52 00000100:00100000:1.0:1788836690.252016:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8151554380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f990379c-347e-4ded-be44-9f2a58ff1508+37:18879:x1875730511339904:12345-192.168.201.44@tcp:101:bash.0 00010000:00010000:1.0:1788836690.252041:0:22756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836690.252062:0:22756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15a00/0xbd163c73757167ab lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4f244a55304e620 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836690.252116:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15a00/0xbd163c73757167ab lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e620 expref: 38 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836690.252131:0:22756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15a00/0xbd163c73757167ab lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e620 expref: 38 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836690.252149:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a8144d12400) 00010000:00010000:1.0:1788836690.252152:0:22756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788836690.252155:0:22756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a817ed15a00, rc 0) 00000100:00100000:1.0:1788836690.252217:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8151554380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f990379c-347e-4ded-be44-9f2a58ff1508+38:18879:x1875730511339904:12345-192.168.201.44@tcp:101:bash.0 Request processed in 201us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836690.252224:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 52 00000100:00100000:1.0:1788836690.260238:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836690.260962:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511340032 00000100:00100000:2.0:1788836690.260976:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511340032 00000100:00100000:3.0:1788836690.261288:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 53 00000100:00100000:3.0:1788836690.261310:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81485dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f990379c-347e-4ded-be44-9f2a58ff1508+38:18879:x1875730511340032:12345-192.168.201.44@tcp:101:bash.0 00010000:00010000:3.0:1788836690.261331:0:22754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836690.261365:0:22754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e6000/0xbd163c73757167b2 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4f244a55304e627 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836690.261509:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7600/0xbd163c73757167b9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836690.261530:0:22754:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434200/0xbd163c7375716796 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e619 expref: 39 pid: 24288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836690.261539:0:22754:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7600/0xbd163c73757167b9 lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836690.261589:0:22754:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434200/0xbd163c7375716796 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e619 expref: 39 pid: 24288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836690.261601:0:22754:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434200/0xbd163c7375716796 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e619 expref: 39 pid: 24288 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836690.261621:0:22754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f50ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22754:1875730518803840:192.168.201.44@tcp:104: 00000100:00100000:3.0:1788836690.261743:0:22754:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a817f4b7180 going to sleep for 11 seconds 00000100:00100000:3.0:1788836690.265439:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836690.265594:0:22754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f50ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22754:1875730518803840:192.168.201.44@tcp:104: 00010000:00010000:1.0:1788836690.265622:0:22754:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7600/0xbd163c73757167b9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836690.267247:0:25098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511340160 00000100:00100000:2.0:1788836690.267260:0:25098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511340160 00010000:00010000:2.0:1788836690.267373:0:25098:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434200/0xbd163c7375716796 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e619 expref: 40 pid: 24288 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836690.267477:0:25098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 19 00000100:00100000:2.0:1788836690.267498:0:25098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f50ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f990379c-347e-4ded-be44-9f2a58ff1508+40:2408:x1875730511340160:12345-192.168.201.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836690.267514:0:25098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836690.267522:0:25098:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434200/0xbd163c7375716796 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e619 expref: 40 pid: 24288 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836690.267553:0:25098:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434200/0xbd163c7375716796 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e619 expref: 40 pid: 24288 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836690.267576:0:25098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434200/0xbd163c7375716796 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e619 expref: 40 pid: 24288 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836690.267593:0:25098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a8144d12400) 00010000:00010000:2.0:1788836690.267599:0:25098:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7600/0xbd163c73757167b9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836690.267608:0:25098:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7600/0xbd163c73757167b9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836690.267615:0:25098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7600/0xbd163c73757167b9 lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836690.267645:0:25098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836690.267731:0:25098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f50ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f990379c-347e-4ded-be44-9f2a58ff1508+39:2408:x1875730511340160:12345-192.168.201.44@tcp:103:ldlm_bl.0 Request processed in 244us (2302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836690.267738:0:25098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 19 00010000:00010000:1.0:1788836690.268392:0:22754:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7600/0xbd163c73757167b9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836690.268403:0:22754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7600/0xbd163c73757167b9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836690.268458:0:22754:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788836690.268494:0:22754:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788836690.268517:0:22754:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7600/0xbd163c73757167b9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836690.268551:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e6000/0xbd163c73757167b2 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e627 expref: 39 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836690.268568:0:22754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7600/0xbd163c73757167b9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e627 expref: 38 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836690.268575:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a8144d12400) 00010000:00010000:1.0:1788836690.268578:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788836690.268581:0:22754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a80462e7600, rc 0) 00000100:00100000:1.0:1788836690.268632:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81485dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f990379c-347e-4ded-be44-9f2a58ff1508+38:18879:x1875730511340032:12345-192.168.201.44@tcp:101:bash.0 Request processed in 7325us (8406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836690.268639:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 53 00000100:00100000:3.0:1788836690.275022:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836690.275178:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511340416 00000100:00100000:1.0:1788836690.275203:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511340416 00000100:00100000:1.0:1788836690.275269:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 3 00000100:00100000:1.0:1788836690.275279:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f50d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f990379c-347e-4ded-be44-9f2a58ff1508+38:18879:x1875730511340416:12345-192.168.201.44@tcp:103:bash.0 00010000:00010000:1.0:1788836690.275305:0:22742:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788836690.275331:0:22742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15a00/0xbd163c73757167ab lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e620 expref: 38 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836690.275353:0:22742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7600/0xbd163c73757167b9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e627 expref: 37 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836690.275366:0:22742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a8144d12400) 00010000:00010000:1.0:1788836690.275371:0:22742:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836690.275432:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f50d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f990379c-347e-4ded-be44-9f2a58ff1508+36:18879:x1875730511340416:12345-192.168.201.44@tcp:103:bash.0 Request processed in 154us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836690.275439:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 3 00000100:00100000:0.0:1788836690.279864:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836690.280090:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511340544 00000100:00100000:1.0:1788836690.280101:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511340544 00000100:00100000:1.0:1788836690.280160:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 54 00000100:00100000:1.0:1788836690.280170:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8151556300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f990379c-347e-4ded-be44-9f2a58ff1508+36:18879:x1875730511340544:12345-192.168.201.44@tcp:58:bash.0 00010000:00010000:1.0:1788836690.280279:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15c00/0xbd163c73757167c0 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836690.280309:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15c00/0xbd163c73757167c0 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836690.280322:0:22756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15c00/0xbd163c73757167c0 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788836690.284386:0:22756:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788836690.284436:0:22756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:1.0:1788836690.284833:0:22756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:1.0:1788836690.285144:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8151556300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f990379c-347e-4ded-be44-9f2a58ff1508+36:18879:x1875730511340544:12345-192.168.201.44@tcp:58:bash.0 Request processed in 4968us (5284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836690.285156:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 54 00000100:00100000:0.0:1788836690.291412:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836690.291579:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511340672 00000100:00100000:3.0:1788836690.291590:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511340672 00000100:00100000:3.0:1788836690.291652:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 55 00000100:00100000:3.0:1788836690.291663:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8151555f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f990379c-347e-4ded-be44-9f2a58ff1508+36:18879:x1875730511340672:12345-192.168.201.44@tcp:101:bash.0 00010000:00010000:3.0:1788836690.291685:0:22755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836690.291707:0:22755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7a00/0xbd163c73757167c7 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4f244a55304e62e expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836690.293684:0:22755:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15c00/0xbd163c73757167c0 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836690.293706:0:22755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7a00/0xbd163c73757167c7 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e62e expref: 37 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836690.293735:0:22755:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15c00/0xbd163c73757167c0 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836690.293754:0:22755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7a00/0xbd163c73757167c7 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e62e expref: 37 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836690.293770:0:22755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a8144d12400) 00010000:00010000:3.0:1788836690.293773:0:22755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788836690.293777:0:22755:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7a00/0xbd163c73757167c7 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e62e expref: 37 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836690.293785:0:22755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a80462e7a00, rc 0) 00000100:00100000:3.0:1788836690.293859:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8151555f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f990379c-347e-4ded-be44-9f2a58ff1508+37:18879:x1875730511340672:12345-192.168.201.44@tcp:101:bash.0 Request processed in 2198us (2456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836690.293869:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 55 00010000:00010000:0.0:1788836690.597760:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836690.789895:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788836690.789919:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f50d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875730518803968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788836690.790001:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788836690.790081:0:24268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518803968 00000100:00100000:0.0:1788836690.790089:0:24268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518803968 00000100:00100000:0.0:1788836690.790145:0:24268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788836690.790154:0:24268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8151555c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875730518803968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788836690.790180:0:24268:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788836690.790221:0:24268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8151555c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875730518803968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836690.790243:0:24268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788836690.790298:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f50d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875730518803968:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788836690.790584:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788836690.790595:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a81485dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875730518804096:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788836690.790629:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788836690.790877:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788836690.790889:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518804096 00000100:00100000:2.0:1788836690.790893:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518804096 00000100:00100000:2.0:1788836690.790922:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788836690.790930:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81485de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875730518804096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788836690.790950:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788836690.790989:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81485de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875730518804096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836690.791003:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788836690.791053:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a81485dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875730518804096:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788836690.791314:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f50fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875730518804480:0@lo:400:kworker.0 00000100:00100000:3.0:1788836690.791348:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836690.791368:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8048e75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875730518804992:0@lo:400:kworker.0 00000100:00100000:3.0:1788836690.791391:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836690.791406:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a81485f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875730518805504:0@lo:400:kworker.0 00000100:00100000:3.0:1788836690.791437:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836690.791453:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788836690.791459:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f50c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875730518804352:0@lo:400:kworker.0 00000100:00100000:3.0:1788836690.791504:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836690.791519:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f50e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875730518804864:0@lo:400:kworker.0 00000100:00100000:3.0:1788836690.791538:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836690.791552:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8166d89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1875730518805376:0@lo:400:kworker.0 00000100:00100000:3.0:1788836690.791572:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836690.791594:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f50c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d9f3bec-9812-4f3e-be22-5440158bfa78:3621:1875730518804224:0@lo:400:kworker.0 00000100:00100000:3.0:1788836690.791632:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836690.791654:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f50ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875730518804736:0@lo:400:kworker.0 00000100:00100000:3.0:1788836690.791687:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836690.791701:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8166d8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1875730518805248:0@lo:400:kworker.0 00000100:00100000:3.0:1788836690.791722:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836690.791739:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788836690.791745:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f50d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875730518804608:0@lo:400:kworker.0 00000100:00100000:3.0:1788836690.791765:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836690.791774:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8048e76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1875730518805120:0@lo:400:kworker.0 00000100:00100000:3.0:1788836690.791791:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836690.791813:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518804992 00000100:00100000:3.0:1788836690.791817:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518804992 00000100:00100000:3.0:1788836690.791844:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518805504 00000100:00100000:3.0:1788836690.791847:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518805504 00000100:00100000:3.0:1788836690.791860:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518805376 00000100:00100000:3.0:1788836690.791862:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518805376 00000100:00100000:3.0:1788836690.791873:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518805248 00000100:00100000:3.0:1788836690.791881:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518805248 00000100:00100000:3.0:1788836690.791895:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518804608 00000100:00100000:3.0:1788836690.791897:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518804608 00000100:00100000:3.0:1788836690.791906:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518805120 00000100:00100000:3.0:1788836690.791908:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518805120 00000100:00100000:3.0:1788836690.791921:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788836690.791928:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81485f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875730518804992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836690.791983:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81485f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875730518804992:12345-0@lo:400:kworker.0 Request processed in 55us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836690.791990:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788836690.792033:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8048e75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875730518804992:0@lo:400:kworker.0 00000100:00100000:3.0:1788836690.792054:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788836690.792061:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81485f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875730518805504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836690.792093:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81485f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875730518805504:12345-0@lo:400:kworker.0 Request processed in 33us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836690.792099:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:3.0:1788836690.792123:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a81485f5180 x1875730518805504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836706 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836690.792134:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a81485f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875730518805504:0@lo:400:kworker.0 00000100:00100000:3.0:1788836690.792151:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788836690.792158:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81485f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875730518805376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836690.792189:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81485f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875730518805376:12345-0@lo:400:kworker.0 Request processed in 32us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836690.792195:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788836690.792215:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8166d89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1875730518805376:0@lo:400:kworker.0 00000100:00100000:3.0:1788836690.792242:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788836690.792249:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81485f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875730518805248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836690.792283:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81485f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875730518805248:12345-0@lo:400:kworker.0 Request processed in 35us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836690.792290:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:3.0:1788836690.792311:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a8166d8b800 x1875730518805248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788836706 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788836690.792320:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8166d8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1875730518805248:0@lo:400:kworker.0 00000100:00100000:3.0:1788836690.792335:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788836690.792341:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81485f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875730518804608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836690.792371:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81485f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875730518804608:12345-0@lo:400:kworker.0 Request processed in 30us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836690.792378:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788836690.792399:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f50d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875730518804608:0@lo:400:kworker.0 00000100:00100000:3.0:1788836690.792429:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788836690.792436:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81485f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875730518805120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836690.792492:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81485f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875730518805120:12345-0@lo:400:kworker.0 Request processed in 56us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836690.792498:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788836690.792519:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8048e76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1875730518805120:0@lo:400:kworker.0 00000100:00080000:1.0:1788836690.794502:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788836690.794513:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788836690.794517:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788836690.794649:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518804480 00000100:00100000:2.0:1788836690.794660:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518804480 00000100:00100000:2.0:1788836690.794737:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518804864 00000100:00100000:2.0:1788836690.794741:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518804864 00000100:00100000:2.0:1788836690.794774:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788836690.794784:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81485f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875730518804480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836690.794874:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81485f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875730518804480:12345-0@lo:400:kworker.0 Request processed in 92us (3525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836690.794882:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788836690.794899:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788836690.794905:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81485f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875730518804864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788836690.794932:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81485f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875730518804864:12345-0@lo:400:kworker.0 Request processed in 27us (3393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836690.794950:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788836690.794972:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518804352 00000100:00100000:2.0:1788836690.794976:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518804352 00000100:00100000:3.0:1788836690.795310:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518804736 00000100:00100000:3.0:1788836690.795315:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518804736 00000100:00100000:3.0:1788836690.795337:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788836690.795343:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81485f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875730518804352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836690.795394:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81485f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875730518804352:12345-0@lo:400:kworker.0 Request processed in 51us (3889us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836690.795400:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788836690.795411:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788836690.795416:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81485f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875730518804736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788836690.795445:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81485f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875730518804736:12345-0@lo:400:kworker.0 Request processed in 29us (3758us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836690.795450:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788836690.795506:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f50ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875730518804736:0@lo:400:kworker.0 00000100:00100000:3.0:1788836690.795543:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f50c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875730518804352:0@lo:400:kworker.0 00000100:00100000:3.0:1788836690.795553:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f50e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875730518804864:0@lo:400:kworker.0 00000100:00100000:3.0:1788836690.795564:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f50fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875730518804480:0@lo:400:kworker.0 00000100:00080000:1.0:1788836690.795698:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788836690.802959:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518804224 00000100:00100000:0.0:1788836690.802979:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518804224 00000100:00100000:0.0:1788836690.803148:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788836690.803160:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81446a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+24:3621:x1875730518804224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788836690.803277:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81446a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d9f3bec-9812-4f3e-be22-5440158bfa78+24:3621:x1875730518804224:12345-0@lo:400:kworker.0 Request processed in 120us (11644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836690.803293:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788836690.805594:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f50c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5d9f3bec-9812-4f3e-be22-5440158bfa78:3621:1875730518804224:0@lo:400:kworker.0 00000040:00080000:1.0:1788836690.918695:0:22791:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788836690.918704:0:22791:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788836690.918752:0:22791:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1788836690.918761:0:22791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1788836690.918923:0:22791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a81485dd180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22791:1875730518805632:192.168.201.44@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788836690.919085:0:22791:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a81451499c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788836690.923717:0:22791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a81485dd180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22791:1875730518805632:192.168.201.44@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788836690.933963:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836690.934339:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511340800 00000100:00100000:3.0:1788836690.934350:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511340800 00000100:00100000:3.0:1788836690.934651:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 56 00000100:00100000:3.0:1788836690.934663:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8151554000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f990379c-347e-4ded-be44-9f2a58ff1508+37:18881:x1875730511340800:12345-192.168.201.44@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788836690.934696:0:22755:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788836690.934823:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8151554000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f990379c-347e-4ded-be44-9f2a58ff1508+37:18881:x1875730511340800:12345-192.168.201.44@tcp:53:lhsmtool_posix.0 Request processed in 162us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836690.934831:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 56 00000100:00100000:0.0:1788836690.949759:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836690.953181:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511340928 00000100:00100000:1.0:1788836690.953196:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511340928 00000100:00100000:1.0:1788836690.953275:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 57 00000100:00100000:1.0:1788836690.953295:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8151557800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f990379c-347e-4ded-be44-9f2a58ff1508+37:18881:x1875730511340928:12345-192.168.201.44@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788836690.953388:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15a00/0xbd163c73757167ce lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836690.953406:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15a00/0xbd163c73757167ce lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836690.953438:0:22756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15a00/0xbd163c73757167ce lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836690.953515:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed14e00/0xbd163c73757167d5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836690.953524:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed14e00/0xbd163c73757167d5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836690.953531:0:22756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed14e00/0xbd163c73757167d5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836690.953554:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15000/0xbd163c73757167dc lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836690.953562:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15000/0xbd163c73757167dc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836690.953567:0:22756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15000/0xbd163c73757167dc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836690.953613:0:22756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788836690.953617:0:22756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788836690.953633:0:22756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15000/0xbd163c73757167dc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836690.953643:0:22756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15a00/0xbd163c73757167ce lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836690.953649:0:22756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15a00/0xbd163c73757167ce lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836690.953664:0:22756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15a00/0xbd163c73757167ce lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836690.953669:0:22756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a817ed15a00 already unused, calling callback (ffffffffc19ae4f0) 00010000:00010000:1.0:1788836690.953673:0:22756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15a00/0xbd163c73757167ce lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836690.953679:0:22756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15a00/0xbd163c73757167ce lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836690.953691:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8047362f00) 00010000:00010000:1.0:1788836690.953694:0:22756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836690.953698:0:22756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15a00/0xbd163c73757167ce lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836690.953703:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15a00/0xbd163c73757167ce lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836690.953717:0:22756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed14e00/0xbd163c73757167d5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836690.953722:0:22756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed14e00/0xbd163c73757167d5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836690.953727:0:22756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed14e00/0xbd163c73757167d5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836690.953731:0:22756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a817ed14e00 already unused, calling callback (ffffffffc19ae4f0) 00010000:00010000:1.0:1788836690.953734:0:22756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed14e00/0xbd163c73757167d5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836690.953747:0:22756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed14e00/0xbd163c73757167d5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836690.953755:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff9a81647cb100) 00010000:00010000:1.0:1788836690.953757:0:22756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836690.953759:0:22756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed14e00/0xbd163c73757167d5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836690.953764:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed14e00/0xbd163c73757167d5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836690.953778:0:22756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15000/0xbd163c73757167dc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836690.953783:0:22756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15000/0xbd163c73757167dc lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836690.953788:0:22756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15000/0xbd163c73757167dc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836690.953792:0:22756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a817ed15000 already unused, calling callback (ffffffffc19ae4f0) 00010000:00010000:1.0:1788836690.953794:0:22756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15000/0xbd163c73757167dc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836690.953799:0:22756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15000/0xbd163c73757167dc lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836690.953805:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a8144d12400) 00010000:00010000:1.0:1788836690.953807:0:22756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836690.953810:0:22756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15000/0xbd163c73757167dc lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836690.953827:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15000/0xbd163c73757167dc lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836690.954243:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8151557800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f990379c-347e-4ded-be44-9f2a58ff1508+37:18881:x1875730511340928:12345-192.168.201.44@tcp:34:lhsmtool_posix.0 Request processed in 948us (4492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836690.954252:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 57 00000100:00100000:0.0:1788836690.961392:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836690.961627:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511341184 00000100:00100000:3.0:1788836690.961638:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511341184 00000100:00100000:3.0:1788836690.961715:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 58 00000100:00100000:3.0:1788836690.961726:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8151557480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f990379c-347e-4ded-be44-9f2a58ff1508+37:18881:x1875730511341184:12345-192.168.201.44@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788836690.961752:0:22755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836690.961771:0:22755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7e00/0xbd163c73757167e3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4f244a55304e635 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836690.961884:0:22755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7200/0xbd163c73757167ea lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836690.961899:0:22755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7200/0xbd163c73757167ea lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836690.961910:0:22755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7200/0xbd163c73757167ea lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788836690.961921:0:22755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788836690.962232:0:22755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7200/0xbd163c73757167ea lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836690.962241:0:22755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7200/0xbd163c73757167ea lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836690.962247:0:22755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7200/0xbd163c73757167ea lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836690.962253:0:22755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a80462e7200 already unused, calling callback (ffffffffc19ae4f0) 00010000:00010000:3.0:1788836690.962257:0:22755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7200/0xbd163c73757167ea lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836690.962264:0:22755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7200/0xbd163c73757167ea lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836690.962288:0:22755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a8144d12400) 00010000:00010000:3.0:1788836690.962291:0:22755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788836690.962296:0:22755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7200/0xbd163c73757167ea lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836690.962302:0:22755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7200/0xbd163c73757167ea lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836690.962357:0:22755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7e00/0xbd163c73757167e3 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e635 expref: 39 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836690.962368:0:22755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8047362f00) 00010000:00010000:3.0:1788836690.962372:0:22755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788836690.962375:0:22755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7e00/0xbd163c73757167e3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e635 expref: 39 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836690.962385:0:22755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a80462e7e00, rc 0) 00000100:00100000:3.0:1788836690.962450:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8151557480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f990379c-347e-4ded-be44-9f2a58ff1508+38:18881:x1875730511341184:12345-192.168.201.44@tcp:101:lhsmtool_posix.0 Request processed in 726us (1069us total) trans 12884901915 rc 301/301 00000100:00100000:3.0:1788836690.962458:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 58 00000100:00100000:0.0:1788836690.982500:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836690.983110:0:24288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511341312 00000100:00100000:3.0:1788836690.983121:0:24288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511341312 00000100:00100000:3.0:1788836690.983181:0:24288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 59 00000100:00100000:3.0:1788836690.983191:0:24288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a80455a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f990379c-347e-4ded-be44-9f2a58ff1508+38:18881:x1875730511341312:12345-192.168.201.44@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788836690.983225:0:24288:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788836690.983360:0:24288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a80455a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f990379c-347e-4ded-be44-9f2a58ff1508+38:18881:x1875730511341312:12345-192.168.201.44@tcp:53:lhsmtool_posix.0 Request processed in 169us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836690.983383:0:24288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 59 00000100:00100000:0.0:1788836690.988634:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836690.988899:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511341568 00000100:00100000:1.0:1788836690.988910:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511341568 00000100:00100000:1.0:1788836690.988984:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 60 00000100:00100000:1.0:1788836690.988996:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81412e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f990379c-347e-4ded-be44-9f2a58ff1508+38:18881:x1875730511341568:12345-192.168.201.44@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788836690.989029:0:22754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836690.989050:0:22754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15000/0xbd163c73757167f8 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4f244a55304e63c expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788836690.989577:0:22754:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x23:0x0], count =31 00000004:00080000:1.0:1788836690.989584:0:22754:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x23:0x0]+31 in llog 00000004:00080000:1.0:1788836690.989605:0:22754:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:1.0:1788836690.989752:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed14e00/0xbd163c73757167ff lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836690.989767:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed14e00/0xbd163c73757167ff lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836690.989778:0:22754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed14e00/0xbd163c73757167ff lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836690.989835:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15000/0xbd163c73757167f8 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e63c expref: 41 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836690.989875:0:22754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed14e00/0xbd163c73757167ff lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e63c expref: 40 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836690.989883:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a81647cb100) 00010000:00010000:1.0:1788836690.989886:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788836690.989889:0:22754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a817ed14e00, rc 0) 00000100:00100000:1.0:1788836690.989964:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81412e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f990379c-347e-4ded-be44-9f2a58ff1508+40:18881:x1875730511341568:12345-192.168.201.44@tcp:101:lhsmtool_posix.0 Request processed in 970us (1342us total) trans 12884901916 rc 0/0 00000100:00100000:1.0:1788836690.989971:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 60 00000100:00100000:0.0:1788836690.996566:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836690.996695:0:24288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511341824 00000100:00100000:3.0:1788836690.996705:0:24288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511341824 00000100:00100000:3.0:1788836690.996759:0:24288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 61 00000100:00100000:3.0:1788836690.996770:0:24288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166e96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f990379c-347e-4ded-be44-9f2a58ff1508+40:18881:x1875730511341824:12345-192.168.201.44@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788836690.996830:0:24288:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836690.996855:0:24288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed14e00/0xbd163c73757167ff lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e63c expref: 40 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836690.996874:0:24288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a81647cb100) 00010000:00010000:3.0:1788836690.996883:0:24288:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788836690.996907:0:24288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7e00/0xbd163c737571680d lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836690.996920:0:24288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7e00/0xbd163c737571680d lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836690.996929:0:24288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7e00/0xbd163c737571680d lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836690.996955:0:24288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7200/0xbd163c7375716814 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x3a7a3f40 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836690.996963:0:24288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7200/0xbd163c7375716814 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3a7a3f40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836690.996969:0:24288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7200/0xbd163c7375716814 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3a7a3f40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836690.997029:0:24288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7e00/0xbd163c737571680d lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836690.997037:0:24288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7e00/0xbd163c737571680d lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836690.997043:0:24288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7e00/0xbd163c737571680d lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836690.997049:0:24288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a80462e7e00 already unused, calling callback (ffffffffc19ae4f0) 00010000:00010000:3.0:1788836690.997053:0:24288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7e00/0xbd163c737571680d lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836690.997062:0:24288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7e00/0xbd163c737571680d lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836690.997071:0:24288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a8047362300) 00010000:00010000:3.0:1788836690.997074:0:24288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836690.997078:0:24288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7e00/0xbd163c737571680d lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836690.997084:0:24288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7e00/0xbd163c737571680d lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836690.997093:0:24288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7200/0xbd163c7375716814 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3a7a3f40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836690.997099:0:24288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7200/0xbd163c7375716814 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3a7a3f40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836690.997105:0:24288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7200/0xbd163c7375716814 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3a7a3f40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836690.997128:0:24288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a80462e7200 already unused, calling callback (ffffffffc19ae4f0) 00010000:00010000:3.0:1788836690.997131:0:24288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7200/0xbd163c7375716814 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3a7a3f40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836690.997137:0:24288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7200/0xbd163c7375716814 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3a7a3f40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836690.997146:0:24288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x3a7a3f40 (ffff9a8164675100) 00010000:00010000:3.0:1788836690.997148:0:24288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836690.997151:0:24288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7200/0xbd163c7375716814 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x3a7a3f40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836690.997156:0:24288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7200/0xbd163c7375716814 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x3a7a3f40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836690.997728:0:24288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166e96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f990379c-347e-4ded-be44-9f2a58ff1508+39:18881:x1875730511341824:12345-192.168.201.44@tcp:36:lhsmtool_posix.0 Request processed in 957us (1169us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788836690.997736:0:24288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 61 00000100:00100000:0.0:1788836691.000894:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836691.001074:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511341952 00000100:00100000:2.0:1788836691.001085:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511341952 00000100:00100000:2.0:1788836691.001180:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 62 00000100:00100000:2.0:1788836691.001193:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8181baea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f990379c-347e-4ded-be44-9f2a58ff1508+39:18881:x1875730511341952:12345-192.168.201.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788836691.001212:0:22754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788836691.001236:0:22754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434a00/0xbd163c737571681b lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4f244a55304e643 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836691.001303:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434600/0xbd163c7375716822 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836691.001318:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434600/0xbd163c7375716822 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836691.001328:0:22754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434600/0xbd163c7375716822 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836691.001441:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434a00/0xbd163c737571681b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e643 expref: 41 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836691.001458:0:22754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434600/0xbd163c7375716822 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e643 expref: 40 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836691.001499:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a8047362d00) 00010000:00010000:2.0:1788836691.001502:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788836691.001505:0:22754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8048434600, rc 0) 00000100:00100000:2.0:1788836691.001564:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8181baea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f990379c-347e-4ded-be44-9f2a58ff1508+40:18881:x1875730511341952:12345-192.168.201.44@tcp:101:lhsmtool_posix.0 Request processed in 375us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836691.001571:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 62 00000100:00080000:3.0:1788836691.005020:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788836691.005664:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836691.006441:0:24288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511342208 00000100:00100000:3.0:1788836691.006454:0:24288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511342208 00000100:00100000:3.0:1788836691.006538:0:24288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 63 00000100:00100000:3.0:1788836691.006548:0:24288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8148659500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f990379c-347e-4ded-be44-9f2a58ff1508+40:18881:x1875730511342208:12345-192.168.201.44@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788836691.006635:0:24288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7000/0xbd163c7375716829 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.006653:0:24288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7000/0xbd163c7375716829 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.006684:0:24288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7000/0xbd163c7375716829 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788836691.006862:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:3.0:1788836691.007153:0:24288:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721080689697ns, next at 722080407400ns, rc = 0 00000004:00010000:3.0:1788836691.007219:0:24288:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a8966253 reply state 000000002fdc1340 transno 12884901917 ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7000/0xbd163c7375716829 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.007233:0:24288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7000/0xbd163c7375716829 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.007240:0:24288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a8047362d00) 00010000:00010000:3.0:1788836691.007243:0:24288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788836691.007247:0:24288:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788836691.007373:0:24288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8148659500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f990379c-347e-4ded-be44-9f2a58ff1508+42:18881:x1875730511342208:12345-192.168.201.44@tcp:36:lhsmtool_posix.0 Request processed in 825us (1713us total) trans 12884901917 rc 0/0 00000100:00100000:3.0:1788836691.007381:0:24288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 63 00000100:00100000:0.0:1788836691.011318:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836691.011899:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511342336 00000100:00100000:1.0:1788836691.011910:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511342336 00000100:00100000:1.0:1788836691.011984:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 64 00000100:00100000:1.0:1788836691.011994:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8181baf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f990379c-347e-4ded-be44-9f2a58ff1508+42:18881:x1875730511342336:12345-192.168.201.44@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788836691.012018:0:22756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836691.012037:0:22756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15000/0xbd163c7375716830 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4f244a55304e64a expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.012093:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15000/0xbd163c7375716830 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e64a expref: 43 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.012119:0:22756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15000/0xbd163c7375716830 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e64a expref: 43 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.012139:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a8047362d00) 00010000:00010000:1.0:1788836691.012143:0:22756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788836691.012160:0:22756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a817ed15000, rc 0) 00000100:00100000:1.0:1788836691.012269:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8181baf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f990379c-347e-4ded-be44-9f2a58ff1508+43:18881:x1875730511342336:12345-192.168.201.44@tcp:101:lhsmtool_posix.0 Request processed in 275us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836691.012276:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 64 00000100:00100000:0.0:1788836691.026308:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836691.026443:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511342464 00000100:00100000:2.0:1788836691.026454:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511342464 00000100:00080000:3.0:1788836691.026607:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788836691.026647:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 25 00000100:00100000:2.0:1788836691.026660:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8181baed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f990379c-347e-4ded-be44-9f2a58ff1508+5:2409:x1875730511342464:12345-192.168.201.44@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788836691.030644:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8181baed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f990379c-347e-4ded-be44-9f2a58ff1508+6:2409:x1875730511342464:12345-192.168.201.44@tcp:2:lhsmtool_posix.0 Request processed in 3975us (4335us total) trans 12884901891 rc 0/0 00000100:00100000:2.0:1788836691.030674:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 25 00000100:00100000:2.0:1788836691.037051:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836691.037214:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511342720 00000100:00100000:3.0:1788836691.037224:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511342720 00000100:00100000:3.0:1788836691.037395:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 11 00000100:00100000:3.0:1788836691.037408:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814865b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f990379c-347e-4ded-be44-9f2a58ff1508+43:18881:x1875730511342720:12345-192.168.201.44@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788836691.037686:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814865b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f990379c-347e-4ded-be44-9f2a58ff1508+44:18881:x1875730511342720:12345-192.168.201.44@tcp:35:lhsmtool_posix.0 Request processed in 281us (643us total) trans 12884901918 rc 0/0 00000100:00100000:3.0:1788836691.037693:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 11 00000100:00100000:0.0:1788836691.042523:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836691.042819:0:24288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511342976 00000100:00100000:3.0:1788836691.042829:0:24288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511342976 00000100:00100000:3.0:1788836691.042963:0:24288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 65 00000100:00100000:3.0:1788836691.042976:0:24288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8181b61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f990379c-347e-4ded-be44-9f2a58ff1508+44:18881:x1875730511342976:12345-192.168.201.44@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788836691.043121:0:24288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8181b61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f990379c-347e-4ded-be44-9f2a58ff1508+44:18881:x1875730511342976:12345-192.168.201.44@tcp:57:lhsmtool_posix.0 Request processed in 140us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836691.043130:0:24288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 65 00000100:00100000:0.0:1788836691.048484:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836691.048741:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511343104 00000100:00100000:1.0:1788836691.048752:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511343104 00000100:00100000:1.0:1788836691.048848:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 66 00000100:00100000:1.0:1788836691.048859:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8181b60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f990379c-347e-4ded-be44-9f2a58ff1508+44:18881:x1875730511343104:12345-192.168.201.44@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788836691.048880:0:22756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836691.048900:0:22756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15a00/0xbd163c7375716837 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4f244a55304e651 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.048983:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed14800/0xbd163c737571683e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.048998:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed14800/0xbd163c737571683e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.049009:0:22756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed14800/0xbd163c737571683e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788836691.049053:0:22756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788836691.049072:0:22756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed14800/0xbd163c737571683e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.049098:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15a00/0xbd163c7375716837 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e651 expref: 46 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.049130:0:22756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed14800/0xbd163c737571683e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e651 expref: 45 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.049157:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a8047362d00) 00010000:00010000:1.0:1788836691.049159:0:22756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788836691.049162:0:22756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a817ed14800, rc 0) 00000100:00100000:1.0:1788836691.049227:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8181b60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f990379c-347e-4ded-be44-9f2a58ff1508+45:18881:x1875730511343104:12345-192.168.201.44@tcp:101:lhsmtool_posix.0 Request processed in 369us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836691.049233:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 66 00000100:00100000:0.0:1788836691.052819:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836691.052919:0:24573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511343232 00000100:00100000:3.0:1788836691.052929:0:24573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511343232 00000100:00100000:3.0:1788836691.053015:0:24573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 26 00000100:00100000:3.0:1788836691.053029:0:24573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8181b61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f990379c-347e-4ded-be44-9f2a58ff1508+6:2408:x1875730511343232:12345-192.168.201.44@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788836691.053054:0:24573:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788836691.053081:0:24573:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b375401/0xbd163c7375716845 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd4f244a55304e658 expref: -99 pid: 24573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788836691.053124:0:24573:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f7b53, blocks: 0x0 00010000:00010000:3.0:1788836691.053149:0:24573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=721s v=(0 0) 00010000:00010000:3.0:1788836691.053153:0:24573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836691.053162:0:24573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b375401/0xbd163c7375716845 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e658 expref: 7 pid: 24573 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.053181:0:24573:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006b375401/0xbd163c7375716845 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e658 expref: 7 pid: 24573 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.053196:0:24573:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a80462e7200, rc 0) 00000100:00100000:3.0:1788836691.053258:0:24573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8181b61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f990379c-347e-4ded-be44-9f2a58ff1508+7:2408:x1875730511343232:12345-192.168.201.44@tcp:101:lhsmtool_posix.0 Request processed in 232us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836691.053265:0:24573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 26 00000100:00100000:2.0:1788836691.056395:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836691.056501:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511343488 00000100:00100000:1.0:1788836691.056514:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511343488 00000100:00100000:1.0:1788836691.056577:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 67 00000100:00100000:1.0:1788836691.056586:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814865b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f990379c-347e-4ded-be44-9f2a58ff1508+45:18881:x1875730511343488:12345-192.168.201.44@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788836691.056694:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814865b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f990379c-347e-4ded-be44-9f2a58ff1508+45:18881:x1875730511343488:12345-192.168.201.44@tcp:57:lhsmtool_posix.0 Request processed in 108us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836691.056701:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 67 00000100:00100000:0.0:1788836691.059755:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836691.059829:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511343616 00000100:00100000:3.0:1788836691.059839:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511343616 00000100:00100000:3.0:1788836691.059894:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 68 00000100:00100000:3.0:1788836691.059904:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8181b62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f990379c-347e-4ded-be44-9f2a58ff1508+45:18881:x1875730511343616:12345-192.168.201.44@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788836691.063657:0:22735:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901918 is committed 00000004:00080000:0.0:1788836691.063675:0:22735:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:0.0:1788836691.063738:0:22735:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000100:00100000:0.0:1788836691.063883:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8181b62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f990379c-347e-4ded-be44-9f2a58ff1508+20:18881:x1875730511343616:12345-192.168.201.44@tcp:44:lhsmtool_posix.0 Request processed in 3974us (4130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836691.063904:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 68 00010000:00010000:2.0:1788836691.064031:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434800/0xbd163c737571665b lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836691.064043:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434800/0xbd163c737571665b lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836691.064051:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434800/0xbd163c737571665b lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836691.064057:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8048434800 already unused, calling callback (ffffffffc19ae4f0) 00010000:00010000:2.0:1788836691.064063:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434800/0xbd163c737571665b lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836691.064071:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434800/0xbd163c737571665b lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836691.064087:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a8047362300) 00010000:00010000:2.0:1788836691.064090:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1788836691.064094:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434800/0xbd163c737571665b lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836691.064101:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434800/0xbd163c737571665b lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.064372:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435400/0xbd163c7375716607 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.064380:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435400/0xbd163c7375716607 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.064386:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435400/0xbd163c7375716607 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.064392:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8048435400 already unused, calling callback (ffffffffc19ae4f0) 00010000:00010000:3.0:1788836691.064395:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435400/0xbd163c7375716607 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.064401:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435400/0xbd163c7375716607 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.064411:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9a8047362200) 00010000:00010000:3.0:1788836691.064413:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836691.064416:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435400/0xbd163c7375716607 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.064421:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435400/0xbd163c7375716607 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.064438:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435c00/0xbd163c737571660e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.064454:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435c00/0xbd163c737571660e lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.064499:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435c00/0xbd163c737571660e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.064505:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8048435c00 already unused, calling callback (ffffffffc19ae4f0) 00010000:00010000:3.0:1788836691.064509:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435c00/0xbd163c737571660e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.064515:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435c00/0xbd163c737571660e lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.064523:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a8047362300) 00010000:00010000:3.0:1788836691.064526:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836691.064529:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435c00/0xbd163c737571660e lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.064534:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048435c00/0xbd163c737571660e lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.064546:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158e000/0xbd163c73757166b6 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.064553:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158e000/0xbd163c73757166b6 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.064559:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158e000/0xbd163c73757166b6 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.064563:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a815158e000 already unused, calling callback (ffffffffc19ae4f0) 00010000:00010000:3.0:1788836691.064571:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158e000/0xbd163c73757166b6 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.064576:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158e000/0xbd163c73757166b6 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.064584:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9a8144d12800) 00010000:00010000:3.0:1788836691.064586:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836691.064589:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158e000/0xbd163c73757166b6 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.064595:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158e000/0xbd163c73757166b6 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.064608:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434c00/0xbd163c737571673b lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.064614:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434c00/0xbd163c737571673b lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.064619:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434c00/0xbd163c737571673b lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.064622:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8048434c00 already unused, calling callback (ffffffffc19ae4f0) 00010000:00010000:3.0:1788836691.064624:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434c00/0xbd163c737571673b lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.064629:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434c00/0xbd163c737571673b lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.064635:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a8144d12400) 00010000:00010000:3.0:1788836691.064637:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836691.064645:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434c00/0xbd163c737571673b lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.064650:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434c00/0xbd163c737571673b lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.064661:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7400/0xbd163c737571675e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.064667:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7400/0xbd163c737571675e lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.064673:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7400/0xbd163c737571675e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.064678:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a80462e7400 already unused, calling callback (ffffffffc19ae4f0) 00010000:00010000:3.0:1788836691.064680:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7400/0xbd163c737571675e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.064686:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7400/0xbd163c737571675e lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.064694:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a8144d12400) 00010000:00010000:3.0:1788836691.064696:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836691.064699:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7400/0xbd163c737571675e lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.064705:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7400/0xbd163c737571675e lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.064715:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434400/0xbd163c73757167a4 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.064720:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434400/0xbd163c73757167a4 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.064731:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434400/0xbd163c73757167a4 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.064736:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8048434400 already unused, calling callback (ffffffffc19ae4f0) 00010000:00010000:3.0:1788836691.064740:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434400/0xbd163c73757167a4 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.064745:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434400/0xbd163c73757167a4 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.064754:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a8144d12400) 00010000:00010000:3.0:1788836691.064756:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788836691.064759:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434400/0xbd163c73757167a4 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.064764:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434400/0xbd163c73757167a4 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.064776:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7000/0xbd163c7375716829 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.064782:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7000/0xbd163c7375716829 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.064788:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7000/0xbd163c7375716829 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.064792:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a80462e7000 already unused, calling callback (ffffffffc19ae4f0) 00010000:00010000:3.0:1788836691.064795:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7000/0xbd163c7375716829 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.064810:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7000/0xbd163c7375716829 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.064818:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a8047362d00) 00010000:00010000:3.0:1788836691.064820:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788836691.064823:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7000/0xbd163c7375716829 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.064829:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7000/0xbd163c7375716829 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24288 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836691.065336:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a81485dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875730518805760:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788836691.065399:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836691.065502:0:24263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518805760 00000100:00100000:1.0:1788836691.065511:0:24263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518805760 00000100:00100000:1.0:1788836691.065565:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788836691.065573:0:24263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8148659c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875730518805760:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788836691.065704:0:24263:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788836691.065708:0:24263:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1788836691.065711:0:24263:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788836691.065713:0:24263:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788836691 -> 1788836691 00002000:00010000:1.0:1788836691.065715:0:24263:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1788836691.065769:0:24263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8148659c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3620:x1875730518805760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 197us (369us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1788836691.065777:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000004:00080000:1.0:1788836691.065825:0:3620:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a81485dd180/2, rc 0, transno 12884901892 00000100:00100000:1.0:1788836691.065831:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a81485dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875730518805760:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788836691.069840:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836691.070005:0:24573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511343744 00000100:00100000:3.0:1788836691.070015:0:24573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511343744 00000100:00100000:3.0:1788836691.070076:0:24573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 28 00000100:00100000:3.0:1788836691.070088:0:24573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8181b62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f990379c-347e-4ded-be44-9f2a58ff1508+7:2409:x1875730511343744:12345-192.168.201.44@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788836691.070214:0:24573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8181b62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f990379c-347e-4ded-be44-9f2a58ff1508+7:2409:x1875730511343744:12345-192.168.201.44@tcp:16:lhsmtool_posix.0 Request processed in 128us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836691.070224:0:24573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 28 00000100:00100000:2.0:1788836691.076378:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836691.076540:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511344000 00000100:00100000:1.0:1788836691.076553:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511344000 00000100:00100000:1.0:1788836691.076620:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 69 00000100:00100000:1.0:1788836691.076631:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8148658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f990379c-347e-4ded-be44-9f2a58ff1508+14:18881:x1875730511344000:12345-192.168.201.44@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788836691.076692:0:22754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836691.076722:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed14800/0xbd163c737571683e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e651 expref: 14 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.076746:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a8047362d00) 00010000:00010000:1.0:1788836691.076751:0:22754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788836691.076782:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15a00/0xbd163c737571684c lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.076796:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15a00/0xbd163c737571684c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.076807:0:22754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15a00/0xbd163c737571684c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788836691.076953:0:22754:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002cdd73f5 reply state 000000002dbd0d97 transno 12884901919 ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15a00/0xbd163c737571684c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.076965:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15a00/0xbd163c737571684c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.076972:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a8047362d00) 00010000:00010000:1.0:1788836691.076975:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788836691.076986:0:22754:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788836691.077101:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8148658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f990379c-347e-4ded-be44-9f2a58ff1508+15:18881:x1875730511344000:12345-192.168.201.44@tcp:36:lhsmtool_posix.0 Request processed in 471us (737us total) trans 12884901919 rc 0/0 00000100:00100000:1.0:1788836691.077109:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 69 00000100:00100000:0.0:1788836691.081027:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836691.081219:0:24263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511344128 00000100:00100000:1.0:1788836691.081232:0:24263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511344128 00000100:00100000:1.0:1788836691.081382:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 29 00000100:00100000:1.0:1788836691.081392:0:24263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8181b60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f990379c-347e-4ded-be44-9f2a58ff1508+7:18881:x1875730511344128:12345-192.168.201.44@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788836691.081410:0:24263:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836691.081428:0:24263:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a479756d/0xbd163c7375716853 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd4f244a55304e65f expref: -99 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.081496:0:24263:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006b375401/0xbd163c7375716845 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e658 expref: 8 pid: 24573 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.081506:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836691.081510:0:24263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836691.081516:0:24263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a479756d/0xbd163c7375716853 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e65f expref: 8 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.081554:0:24263:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006b375401/0xbd163c7375716845 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e658 expref: 8 pid: 24573 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.081568:0:24263:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006b375401/0xbd163c7375716845 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e658 expref: 8 pid: 24573 timeout: 821 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836691.081583:0:24263:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a81485dc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:24263:1875730518805888:192.168.201.44@tcp:104: 00000100:00100000:1.0:1788836691.081685:0:24263:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8153af0000 going to sleep for 11 seconds 00000100:00100000:0.0:1788836691.086602:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836691.086746:0:24263:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a81485dc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:24263:1875730518805888:192.168.201.44@tcp:104: 00010000:00010000:1.0:1788836691.086779:0:24263:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a479756d/0xbd163c7375716853 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e65f expref: 8 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.086802:0:24263:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a817ed14400, rc 0) 00000100:00100000:1.0:1788836691.086852:0:24263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8181b60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f990379c-347e-4ded-be44-9f2a58ff1508+8:18881:x1875730511344128:12345-192.168.201.44@tcp:101:lhsmtool_posix.0 Request processed in 5461us (5837us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836691.086860:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 29 00000100:00100000:3.0:1788836691.086926:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511344256 00000100:00100000:3.0:1788836691.086944:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511344256 00010000:00010000:3.0:1788836691.086978:0:22740:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006b375401/0xbd163c7375716845 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e658 expref: 8 pid: 24573 timeout: 821 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836691.087015:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 20 00000100:00100000:3.0:1788836691.087025:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8181b62680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f990379c-347e-4ded-be44-9f2a58ff1508+8:2409:x1875730511344256:12345-192.168.201.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788836691.087037:0:22740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788836691.087058:0:22740:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006b375401/0xbd163c7375716845 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e658 expref: 8 pid: 24573 timeout: 821 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.087079:0:22740:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006b375401/0xbd163c7375716845 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e658 expref: 8 pid: 24573 timeout: 821 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.087103:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b375401/0xbd163c7375716845 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e658 expref: 8 pid: 24573 timeout: 821 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.087127:0:22740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836691.087132:0:22740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788836691.087137:0:22740:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a479756d/0xbd163c7375716853 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e65f expref: 7 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.087148:0:22740:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a479756d/0xbd163c7375716853 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e65f expref: 7 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.087182:0:22740:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a479756d/0xbd163c7375716853 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e65f expref: 7 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836691.087196:0:22740:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a81485f5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:22740:1875730518806016:192.168.201.44@tcp:105: 00000100:00100000:3.0:1788836691.087248:0:22740:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a817f4b7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836691.091435:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836691.091557:0:22740:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a81485f5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:22740:1875730518806016:192.168.201.44@tcp:105: 00010000:00010000:2.0:1788836691.091583:0:22740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836691.091648:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8181b62680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f990379c-347e-4ded-be44-9f2a58ff1508+7:2409:x1875730511344256:12345-192.168.201.44@tcp:103:ldlm_bl.0 Request processed in 4624us (5054us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836691.091660:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 20 00000100:00100000:0.0:1788836691.092317:0:24573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511344384 00000100:00100000:0.0:1788836691.092326:0:24573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511344384 00000100:00100000:0.0:1788836691.092385:0:24573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 30 00000100:00100000:0.0:1788836691.092396:0:24573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81485f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f990379c-347e-4ded-be44-9f2a58ff1508+7:2408:x1875730511344384:12345-192.168.201.44@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788836691.092603:0:24573:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788836691.092607:0:24573:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1788836691 00002000:00010000:0.0:1788836691.092610:0:24573:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1788836689 00002000:00010000:0.0:1788836691.092612:0:24573:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788836691 -> 1788836691 00002000:00010000:0.0:1788836691.092614:0:24573:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1788836691.092665:0:24573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81485f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f990379c-347e-4ded-be44-9f2a58ff1508+8:2408:x1875730511344384:12345-192.168.201.44@tcp:2:lhsmtool_posix.0 Request processed in 271us (1241us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1788836691.092673:0:24573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 30 00000100:00100000:3.0:1788836691.096621:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836691.096732:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511344512 00000100:00100000:2.0:1788836691.096744:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511344512 00000100:00100000:2.0:1788836691.096810:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 31 00000100:00100000:2.0:1788836691.096820:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81485f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f990379c-347e-4ded-be44-9f2a58ff1508+8:2410:x1875730511344512:12345-192.168.201.44@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788836691.096868:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000857af1ac/0xbd163c737571685a lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836691.096889:0:24266:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a479756d/0xbd163c7375716853 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e65f expref: 8 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836691.096898:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788836691.096903:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788836691.096908:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000857af1ac/0xbd163c737571685a lrc: 4/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836691.096962:0:24266:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a479756d/0xbd163c7375716853 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e65f expref: 8 pid: 24263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836691.096977:0:24266:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a479756d/0xbd163c7375716853 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e65f expref: 8 pid: 24263 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836691.097016:0:24266:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8148658380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:24266:1875730518806144:192.168.201.44@tcp:104: 00000100:00100000:2.0:1788836691.097100:0:24266:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a81646f2600 going to sleep for 11 seconds 00000100:00100000:3.0:1788836691.102543:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836691.102656:0:24266:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8148658380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:24266:1875730518806144:192.168.201.44@tcp:104: 00010000:00010000:2.0:1788836691.102688:0:24266:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000857af1ac/0xbd163c737571685a lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836691.102764:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511344640 00000100:00100000:1.0:1788836691.102772:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511344640 00010000:00010000:1.0:1788836691.102811:0:22742:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a479756d/0xbd163c7375716853 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e65f expref: 9 pid: 24263 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836691.102849:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 21 00000100:00100000:1.0:1788836691.102858:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81485f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f990379c-347e-4ded-be44-9f2a58ff1508+9:2408:x1875730511344640:12345-192.168.201.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788836691.102872:0:22742:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788836691.102895:0:22742:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a479756d/0xbd163c7375716853 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e65f expref: 9 pid: 24263 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.102908:0:22742:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a479756d/0xbd163c7375716853 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e65f expref: 9 pid: 24263 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.102944:0:22742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a479756d/0xbd163c7375716853 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e65f expref: 9 pid: 24263 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.102987:0:22742:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788836691.102992:0:22742:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788836691.102997:0:22742:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000857af1ac/0xbd163c737571685a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.103006:0:22742:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000857af1ac/0xbd163c737571685a lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.103042:0:22742:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788836691.103093:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81485f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f990379c-347e-4ded-be44-9f2a58ff1508+8:2408:x1875730511344640:12345-192.168.201.44@tcp:103:ldlm_bl.0 Request processed in 235us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836691.103101:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 21 00010000:00010000:3.0:1788836691.105156:0:24266:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000857af1ac/0xbd163c737571685a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.105194:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000857af1ac/0xbd163c737571685a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.105229:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000857af1ac/0xbd163c737571685a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.105238:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000857af1ac/0xbd163c737571685a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.105246:0:24266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000857af1ac/0xbd163c737571685a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.105253:0:24266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8048434800 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:3.0:1788836691.105258:0:24266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000857af1ac/0xbd163c737571685a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.105267:0:24266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000857af1ac/0xbd163c737571685a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.105299:0:24266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000857af1ac/0xbd163c737571685a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788836691.105307:0:24266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000857af1ac/0xbd163c737571685a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836691.105418:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81485f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f990379c-347e-4ded-be44-9f2a58ff1508+7:2410:x1875730511344512:12345-192.168.201.44@tcp:1:lhsmtool_posix.0 Request processed in 8596us (8803us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836691.105427:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 31 00000100:00100000:3.0:1788836691.109619:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836691.109706:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511344896 00000100:00100000:2.0:1788836691.109717:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511344896 00000100:00100000:2.0:1788836691.109779:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 70 00000100:00100000:2.0:1788836691.109789:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81485f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f990379c-347e-4ded-be44-9f2a58ff1508+15:18881:x1875730511344896:12345-192.168.201.44@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788836691.109875:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434400/0xbd163c7375716861 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836691.109892:0:22756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f800/0xbd163c7375716734 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e5fd expref: 15 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836691.109901:0:22756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434400/0xbd163c7375716861 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836691.109943:0:22756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f800/0xbd163c7375716734 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e5fd expref: 15 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836691.109956:0:22756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f800/0xbd163c7375716734 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e5fd expref: 15 pid: 22756 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836691.109991:0:22756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a8148658380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22756:1875730518806272:192.168.201.44@tcp:104: 00000100:00100000:2.0:1788836691.110088:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a81646f2600 going to sleep for 11 seconds 00000100:00100000:2.0:1788836691.113040:0:22756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a8148658380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22756:1875730518806272:192.168.201.44@tcp:104: 00010000:00010000:2.0:1788836691.113073:0:22756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434400/0xbd163c7375716861 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788836691.115006:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836691.115505:0:25098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511345024 00000100:00100000:2.0:1788836691.115515:0:25098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511345024 00010000:00010000:2.0:1788836691.115551:0:25098:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f800/0xbd163c7375716734 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e5fd expref: 16 pid: 22756 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788836691.115587:0:25098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 22 00000100:00100000:2.0:1788836691.115595:0:25098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81485f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f990379c-347e-4ded-be44-9f2a58ff1508+16:2409:x1875730511345024:12345-192.168.201.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788836691.115631:0:25098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788836691.115638:0:25098:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f800/0xbd163c7375716734 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e5fd expref: 16 pid: 22756 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836691.115651:0:25098:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f800/0xbd163c7375716734 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e5fd expref: 16 pid: 22756 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836691.115677:0:25098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158f800/0xbd163c7375716734 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e5fd expref: 16 pid: 22756 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836691.115695:0:25098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a8144d12400) 00010000:00010000:2.0:1788836691.115701:0:25098:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7a00/0xbd163c73757167c7 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e62e expref: 15 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836691.115719:0:25098:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434400/0xbd163c7375716861 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836691.115727:0:25098:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434400/0xbd163c7375716861 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836691.115735:0:25098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434400/0xbd163c7375716861 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788836691.115768:0:25098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788836691.115817:0:25098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81485f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f990379c-347e-4ded-be44-9f2a58ff1508+15:2409:x1875730511345024:12345-192.168.201.44@tcp:103:ldlm_bl.0 Request processed in 222us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836691.115824:0:25098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 22 00010000:00010000:1.0:1788836691.116111:0:22756:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434400/0xbd163c7375716861 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.116121:0:22756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434400/0xbd163c7375716861 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.116333:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed14400/0xbd163c7375716868 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.116346:0:22756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15000/0xbd163c7375716830 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e64a expref: 15 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.116353:0:22756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed14400/0xbd163c7375716868 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.116381:0:22756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15000/0xbd163c7375716830 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e64a expref: 15 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.116400:0:22756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15000/0xbd163c7375716830 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e64a expref: 15 pid: 22756 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836691.116414:0:22756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a81485dc700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22756:1875730518806400:192.168.201.44@tcp:104: 00000100:00100000:1.0:1788836691.116512:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8142aeb3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836691.124304:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:0.0:1788836691.124394:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511345152 00000100:00100000:0.0:1788836691.124406:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511345152 00010000:00010000:0.0:1788836691.124449:0:22742:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15000/0xbd163c7375716830 lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e64a expref: 16 pid: 22756 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836691.124509:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 23 00000100:00100000:0.0:1788836691.124519:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8041423050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f990379c-347e-4ded-be44-9f2a58ff1508+16:2408:x1875730511345152:12345-192.168.201.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788836691.124546:0:22742:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788836691.124554:0:22742:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15000/0xbd163c7375716830 lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e64a expref: 16 pid: 22756 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836691.124583:0:22742:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15000/0xbd163c7375716830 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e64a expref: 16 pid: 22756 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836691.124607:0:22742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a8047362d00) 00010000:00010000:0.0:1788836691.124613:0:22742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed14400/0xbd163c7375716868 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836691.124623:0:22742:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed14400/0xbd163c7375716868 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836691.124631:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed14400/0xbd163c7375716868 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836691.124651:0:22742:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788836691.124708:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8041423050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f990379c-347e-4ded-be44-9f2a58ff1508+16:2408:x1875730511345152:12345-192.168.201.44@tcp:103:ldlm_bl.0 Request processed in 190us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836691.124716:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 23 00010000:00010000:1.0:1788836691.125779:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15000/0xbd163c7375716830 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e64a expref: 15 pid: 22756 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836691.125802:0:22756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a81485dc700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22756:1875730518806400:192.168.201.44@tcp:104: 00010000:00010000:1.0:1788836691.125822:0:22756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed14400/0xbd163c7375716868 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.125830:0:22756:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed14400/0xbd163c7375716868 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.125836:0:22756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed14400/0xbd163c7375716868 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788836691.125970:0:22756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901920 00000001:00080000:1.0:1788836691.126101:0:22756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901921 00000001:00080000:1.0:1788836691.126144:0:22756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901922 00000100:00100000:1.0:1788836691.126227:0:22756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a81485dc700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22756:1875730518806528:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788836691.126299:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836691.126362:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8144d65a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788836691.126431:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518806528 00000100:00100000:3.0:1788836691.126436:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518806528 00000100:00100000:3.0:1788836691.126542:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788836691.126553:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81485de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22756:x1875730518806528:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788836691.126638:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81485de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22756:x1875730518806528:12345-0@lo:1000:mdt00_002.0 Request processed in 87us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836691.126645:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788836691.127451:0:22756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a81485dc700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22756:1875730518806528:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1788836691.127662:0:22756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901923 00000100:00100000:1.0:1788836691.127745:0:22756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a81485dc700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22756:1875730518806656:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788836691.127795:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836691.127836:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8144d659c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836691.128437:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518806656 00000100:00100000:3.0:1788836691.128445:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518806656 00000100:00100000:3.0:1788836691.128537:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788836691.128547:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81485ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22756:x1875730518806656:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788836691.128707:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81485ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22756:x1875730518806656:12345-0@lo:1000:mdt00_002.0 Request processed in 162us (911us total) trans 12884901894 rc 0/0 00000100:00100000:3.0:1788836691.128716:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788836691.129005:0:22756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a81485dc700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22756:1875730518806656:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1788836691.129048:0:22756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed14400/0xbd163c7375716868 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.129059:0:22756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed14400/0xbd163c7375716868 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.129067:0:22756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed14400/0xbd163c7375716868 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.129073:0:22756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a817ed14400 already unused, calling callback (ffffffffc19ae4f0) 00010000:00010000:1.0:1788836691.129078:0:22756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed14400/0xbd163c7375716868 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.129085:0:22756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed14400/0xbd163c7375716868 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.129099:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a8047362d00) 00010000:00010000:1.0:1788836691.129102:0:22756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788836691.129106:0:22756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed14400/0xbd163c7375716868 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.129111:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed14400/0xbd163c7375716868 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.129143:0:22756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15c00/0xbd163c73757167c0 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.129148:0:22756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15c00/0xbd163c73757167c0 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.129165:0:22756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15c00/0xbd163c73757167c0 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.129169:0:22756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a817ed15c00 already unused, calling callback (ffffffffc19ae4f0) 00010000:00010000:1.0:1788836691.129172:0:22756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15c00/0xbd163c73757167c0 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.129177:0:22756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15c00/0xbd163c73757167c0 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.129185:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a8144d12400) 00010000:00010000:1.0:1788836691.129187:0:22756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788836691.129194:0:22756:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7a00/0xbd163c73757167c7 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e62e expref: 18 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.129204:0:22756:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7a00/0xbd163c73757167c7 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e62e expref: 18 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.129211:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7a00/0xbd163c73757167c7 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e62e expref: 18 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.129444:0:22756:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a80462e7a00/0xbd163c73757167c7 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e62e expref: 18 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836691.129482:0:22756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a81485dce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22756:1875730518806784:192.168.201.44@tcp:105: 00000100:00100000:1.0:1788836691.129555:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a8144d659c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788836691.134741:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:0.0:1788836691.134949:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511345280 00000100:00100000:0.0:1788836691.134961:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511345280 00000100:00100000:0.0:1788836691.135022:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 12 00000100:00100000:0.0:1788836691.135034:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81485f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f990379c-347e-4ded-be44-9f2a58ff1508+19:18879:x1875730511345280:12345-192.168.201.44@tcp:49:bash.0 00000100:00100000:0.0:1788836691.135194:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81485f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f990379c-347e-4ded-be44-9f2a58ff1508+19:18879:x1875730511345280:12345-192.168.201.44@tcp:49:bash.0 Request processed in 162us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836691.135201:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 12 00000100:00100000:1.0:1788836691.135835:0:22756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a81485dce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22756:1875730518806784:192.168.201.44@tcp:105: 00010000:00010000:1.0:1788836691.135887:0:22756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15c00/0xbd163c73757167c0 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.135898:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15c00/0xbd163c73757167c0 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.135943:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15000/0xbd163c737571686f lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.135959:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15000/0xbd163c737571686f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.135971:0:22756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15000/0xbd163c737571686f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.135980:0:22756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15000/0xbd163c737571686f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.135986:0:22756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15000/0xbd163c737571686f lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.135992:0:22756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15000/0xbd163c737571686f lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.135997:0:22756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a817ed15000 already unused, calling callback (ffffffffc19ae4f0) 00010000:00010000:1.0:1788836691.136001:0:22756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15000/0xbd163c737571686f lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.136008:0:22756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15000/0xbd163c737571686f lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.136019:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a8144d12400) 00010000:00010000:1.0:1788836691.136027:0:22756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836691.136032:0:22756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15000/0xbd163c737571686f lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.136039:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15000/0xbd163c737571686f lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.136049:0:22756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434400/0xbd163c7375716861 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.136055:0:22756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434400/0xbd163c7375716861 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.136060:0:22756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434400/0xbd163c7375716861 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.136064:0:22756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8048434400 already unused, calling callback (ffffffffc19ae4f0) 00010000:00010000:1.0:1788836691.136066:0:22756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434400/0xbd163c7375716861 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.136071:0:22756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434400/0xbd163c7375716861 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.136078:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a8144d12400) 00010000:00010000:1.0:1788836691.136079:0:22756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788836691.136082:0:22756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434400/0xbd163c7375716861 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.136086:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8048434400/0xbd163c7375716861 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788836691.138551:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81485f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f990379c-347e-4ded-be44-9f2a58ff1508+18:18881:x1875730511344896:12345-192.168.201.44@tcp:57:lhsmtool_posix.0 Request processed in 28743us (28920us total) trans 12884901924 rc 0/0 00000100:00100000:0.0:1788836691.138568:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 70 00000020:00080000:0.0:1788836691.138590:0:22756:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788836691.142040:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836691.142273:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511345408 00000100:00100000:1.0:1788836691.142292:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511345408 00000100:00100000:1.0:1788836691.142357:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 32 00000100:00100000:1.0:1788836691.142367:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81485f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f990379c-347e-4ded-be44-9f2a58ff1508+7:18879:x1875730511345408:12345-192.168.201.44@tcp:101:bash.0 00010000:00010000:1.0:1788836691.142385:0:24264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836691.142405:0:24264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f73ea27/0xbd163c7375716876 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd4f244a55304e666 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788836691.142429:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x6a9f7b53, atime: 0x6a9f7b51, ctime: 0x6a9f7b53, blocks: 0x0 00010000:00010000:1.0:1788836691.142450:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=721s v=(0 0) 00010000:00010000:1.0:1788836691.142455:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788836691.142486:0:24264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f73ea27/0xbd163c7375716876 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e666 expref: 8 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.142503:0:24264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004f73ea27/0xbd163c7375716876 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e666 expref: 8 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.142517:0:24264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a817ed14800, rc 0) 00000100:00100000:1.0:1788836691.142568:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81485f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f990379c-347e-4ded-be44-9f2a58ff1508+8:18879:x1875730511345408:12345-192.168.201.44@tcp:101:bash.0 Request processed in 201us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836691.142575:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 32 00000040:00080000:2.0:1788836691.147882:0:22791:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788836691.147892:0:22791:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788836691.147945:0:22791:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1788836691.147954:0:22791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1788836691.148652:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:2.0:1788836691.148901:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836691.148965:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511345792 00000100:00100000:1.0:1788836691.148975:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511345792 00000100:00100000:1.0:1788836691.149040:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 71 00000100:00100000:1.0:1788836691.149052:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814865a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f990379c-347e-4ded-be44-9f2a58ff1508+18:18879:x1875730511345792:12345-192.168.201.44@tcp:101:bash.0 00010000:00010000:1.0:1788836691.149076:0:22754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788836691.149096:0:22754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15e00/0xbd163c737571687d lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4f244a55304e66d expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.149153:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed14e00/0xbd163c7375716884 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.149166:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed14e00/0xbd163c7375716884 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.149178:0:22754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed14e00/0xbd163c7375716884 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.149292:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15e00/0xbd163c737571687d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e66d expref: 20 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.149310:0:22754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed14e00/0xbd163c7375716884 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e66d expref: 19 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.149318:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a8144d12400) 00010000:00010000:1.0:1788836691.149321:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788836691.149324:0:22754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a817ed14e00, rc 0) 00000100:00100000:1.0:1788836691.149393:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814865a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f990379c-347e-4ded-be44-9f2a58ff1508+19:18879:x1875730511345792:12345-192.168.201.44@tcp:101:bash.0 Request processed in 343us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836691.149400:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 71 00000100:00100000:3.0:1788836691.153576:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:0.0:1788836691.156252:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511345664 00000100:00100000:0.0:1788836691.156270:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511345664 00000100:00100000:1.0:1788836691.156346:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511346048 00000100:00100000:1.0:1788836691.156352:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511346048 00000100:00100000:0.0:1788836691.156430:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 13 00000100:00100000:0.0:1788836691.156441:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8148658380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f990379c-347e-4ded-be44-9f2a58ff1508+20:18881:x1875730511345664:12345-192.168.201.44@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788836691.157166:0:22758:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788836691.157205:0:22758:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901925 00010000:00010000:0.0:1788836691.157242:0:22758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158e200/0xbd163c737571688b lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836691.157260:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158e200/0xbd163c737571688b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836691.157272:0:22758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158e200/0xbd163c737571688b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836691.157348:0:22758:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158e200/0xbd163c737571688b lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836691.157356:0:22758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158e200/0xbd163c737571688b lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836691.157362:0:22758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158e200/0xbd163c737571688b lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836691.157388:0:22758:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788836691.157616:0:23912:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788836691.157624:0:23912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158e200/0xbd163c737571688b lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.157631:0:23912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a815158e200 already unused, calling callback (ffffffffc0db0350) 00010000:00010000:1.0:1788836691.157651:0:23912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158e200/0xbd163c737571688b lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.157660:0:23912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158e200/0xbd163c737571688b lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.157673:0:23912:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a8047362d00) 00010000:00010000:1.0:1788836691.157676:0:23912:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788836691.157680:0:23912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158e200/0xbd163c737571688b lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.157685:0:23912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158e200/0xbd163c737571688b lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.157699:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836691.157701:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788836691.157703:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836691.157774:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8148658380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f990379c-347e-4ded-be44-9f2a58ff1508+22:18881:x1875730511345664:12345-192.168.201.44@tcp:35:lhsmtool_posix.0 Request processed in 1332us (9125us total) trans 12884901926 rc 0/0 00000100:00100000:0.0:1788836691.157785:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 13 00000020:00080000:0.0:1788836691.157791:0:22758:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788836691.157813:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 14 00000100:00100000:0.0:1788836691.157832:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81485f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f990379c-347e-4ded-be44-9f2a58ff1508+21:18879:x1875730511346048:12345-192.168.201.44@tcp:35:bash.0 00000001:00080000:0.0:1788836691.157979:0:22758:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901927 00000001:00080000:0.0:1788836691.158053:0:22758:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901928 00000100:00100000:0.0:1788836691.158105:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81485f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f990379c-347e-4ded-be44-9f2a58ff1508+24:18879:x1875730511346048:12345-192.168.201.44@tcp:35:bash.0 Request processed in 275us (4540us total) trans 12884901929 rc 0/0 00000100:00100000:0.0:1788836691.158802:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 14 00000020:00080000:0.0:1788836691.158807:0:22758:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788836691.267728:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:0.0:1788836691.267943:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511346304 00000100:00100000:0.0:1788836691.267955:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511346304 00000100:00100000:0.0:1788836691.268027:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 72 00000100:00100000:0.0:1788836691.268038:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a814865b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f990379c-347e-4ded-be44-9f2a58ff1508+24:18891:x1875730511346304:12345-192.168.201.44@tcp:101:lfs.0 00010000:00010000:0.0:1788836691.268068:0:22755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788836691.268093:0:22755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158e200/0xbd163c7375716892 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd4f244a55304e674 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788836691.268200:0:22755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788836691.268513:0:22755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158e200/0xbd163c7375716892 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e674 expref: 26 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836691.268528:0:22755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8047362600) 00010000:00010000:0.0:1788836691.268531:0:22755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788836691.268536:0:22755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a815158e200/0xbd163c7375716892 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.44@tcp remote: 0xd4f244a55304e674 expref: 26 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788836691.268552:0:22755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a815158e200, rc 0) 00000100:00100000:0.0:1788836691.268619:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a814865b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f990379c-347e-4ded-be44-9f2a58ff1508+25:18891:x1875730511346304:12345-192.168.201.44@tcp:101:lfs.0 Request processed in 583us (901us total) trans 12884901930 rc 301/301 00000100:00100000:0.0:1788836691.268642:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 72 00000100:00100000:2.0:1788836691.279097:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836691.279209:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511346432 00000100:00100000:1.0:1788836691.279220:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511346432 00000100:00100000:1.0:1788836691.279293:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 73 00000100:00100000:1.0:1788836691.279304:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f536d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f990379c-347e-4ded-be44-9f2a58ff1508+25:18891:x1875730511346432:12345-192.168.201.44@tcp:34:lfs.0 00010000:00010000:1.0:1788836691.279402:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15e00/0xbd163c73757168a0 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.279420:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15e00/0xbd163c73757168a0 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.279433:0:22754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15e00/0xbd163c73757168a0 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.279449:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15000/0xbd163c73757168a7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.279519:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15000/0xbd163c73757168a7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.279526:0:22754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15000/0xbd163c73757168a7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.279618:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15c00/0xbd163c73757168ae lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.279627:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15c00/0xbd163c73757168ae lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.279634:0:22754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15c00/0xbd163c73757168ae lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788836691.279682:0:22754:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15c00/0xbd163c73757168ae lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.279695:0:22754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15e00/0xbd163c73757168a0 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.279702:0:22754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15e00/0xbd163c73757168a0 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.279709:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15e00/0xbd163c73757168a0 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.279715:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a817ed15e00 already unused, calling callback (ffffffffc19ae4f0) 00010000:00010000:1.0:1788836691.279719:0:22754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15e00/0xbd163c73757168a0 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.279728:0:22754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15e00/0xbd163c73757168a0 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.279747:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a8047362300) 00010000:00010000:1.0:1788836691.279751:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836691.279756:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15e00/0xbd163c73757168a0 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.279763:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15e00/0xbd163c73757168a0 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.279775:0:22754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15000/0xbd163c73757168a7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.279781:0:22754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15000/0xbd163c73757168a7 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.279786:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15000/0xbd163c73757168a7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.279792:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a817ed15000 already unused, calling callback (ffffffffc19ae4f0) 00010000:00010000:1.0:1788836691.279794:0:22754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15000/0xbd163c73757168a7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.279800:0:22754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15000/0xbd163c73757168a7 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.279808:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9a81647cb200) 00010000:00010000:1.0:1788836691.279810:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836691.279813:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15000/0xbd163c73757168a7 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.279819:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15000/0xbd163c73757168a7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.279844:0:22754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15c00/0xbd163c73757168ae lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.279850:0:22754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15c00/0xbd163c73757168ae lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.279856:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15c00/0xbd163c73757168ae lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.279861:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a817ed15c00 already unused, calling callback (ffffffffc19ae4f0) 00010000:00010000:1.0:1788836691.279864:0:22754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15c00/0xbd163c73757168ae lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.279869:0:22754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15c00/0xbd163c73757168ae lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.279876:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a8144d12400) 00010000:00010000:1.0:1788836691.279878:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788836691.279881:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15c00/0xbd163c73757168ae lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788836691.279885:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a817ed15c00/0xbd163c73757168ae lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788836691.279971:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f536d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f990379c-347e-4ded-be44-9f2a58ff1508+25:18891:x1875730511346432:12345-192.168.201.44@tcp:34:lfs.0 Request processed in 668us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836691.279980:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 73 00000100:00100000:3.0:1788836691.290023:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836691.290141:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511346688 00000100:00100000:1.0:1788836691.290151:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511346688 00000100:00100000:1.0:1788836691.290212:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 15 00000100:00100000:1.0:1788836691.290240:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81485f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f990379c-347e-4ded-be44-9f2a58ff1508+25:18891:x1875730511346688:12345-192.168.201.44@tcp:35:lfs.0 00000100:00100000:1.0:1788836691.290511:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81485f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f990379c-347e-4ded-be44-9f2a58ff1508+26:18891:x1875730511346688:12345-192.168.201.44@tcp:35:lfs.0 Request processed in 272us (496us total) trans 12884901931 rc 0/0 00000100:00100000:1.0:1788836691.290519:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 15 00010000:00010000:1.0:1788836691.621779:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788836692.648782:0:22744:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788836692.838992:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a81485f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875730518806912:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788836692.839386:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788836692.839495:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518806912 00000100:00100000:1.0:1788836692.839504:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518806912 00000100:00100000:1.0:1788836692.839561:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788836692.839570:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f50ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875730518806912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788836692.839600:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788836692.839670:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f50ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875730518806912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788836692.839677:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788836692.839728:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a81485f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875730518806912:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788836692.839862:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788836692.840075:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788836692.840094:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f534700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875730518807040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788836692.840132:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788836692.840452:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518807040 00000100:00100000:2.0:1788836692.840457:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518807040 00000100:00100000:2.0:1788836692.840526:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788836692.840534:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81485dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3619:x1875730518807040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788836692.840552:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788836692.840591:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81485dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3619:x1875730518807040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836692.840611:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1788836692.840774:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788836692.840809:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f534700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875730518807040:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1788836693.093535:0:25841:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: /mnt/lustre/d1d.sanity-pcc/f1d.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:1.0:1788836693.670067:0:23912:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788836693.861807:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788836693.861830:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f534700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875730518807168:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788836693.861932:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836693.862092:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518807168 00000100:00100000:3.0:1788836693.862100:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518807168 00000100:00100000:3.0:1788836693.862162:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788836693.862172:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8181b62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875730518807168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788836693.862209:0:22761:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788836693.862260:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8181b62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875730518807168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836693.862267:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788836693.862383:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a817f50d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875730518807296:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788836693.862626:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f534700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875730518807168:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788836693.869951:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836693.869992:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836693.870021:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836693.870036:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836693.870062:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836693.870080:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836693.870096:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836693.870116:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836693.870136:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:0.0:1788836693.870323:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511346816 00000100:00100000:0.0:1788836693.870333:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511346816 00000100:00100000:0.0:1788836693.870382:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 171 00000100:00100000:0.0:1788836693.870391:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a81446a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ef4c47b-fc99-4862-96ec-0565fed75f8d+13:2409:x1875730511346816:12345-192.168.201.44@tcp:400:kworker.0 00000100:00100000:0.0:1788836693.870491:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a81446a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2ef4c47b-fc99-4862-96ec-0565fed75f8d+13:2409:x1875730511346816:12345-192.168.201.44@tcp:400:kworker.0 Request processed in 100us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836693.870499:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 171 00000100:00100000:0.0:1788836693.870534:0:24573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511347328 00000100:00100000:0.0:1788836693.870538:0:24573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511347328 00000100:00100000:0.0:1788836693.870564:0:24573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511347840 00000100:00100000:0.0:1788836693.870567:0:24573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511347840 00000100:00100000:0.0:1788836693.870579:0:24573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511347200 00000100:00100000:0.0:1788836693.870581:0:24573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511347200 00000100:00100000:0.0:1788836693.870592:0:24573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511347712 00000100:00100000:0.0:1788836693.870595:0:24573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511347712 00000100:00100000:0.0:1788836693.870608:0:24573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 28 00000100:00100000:0.0:1788836693.870614:0:24573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f50fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f990379c-347e-4ded-be44-9f2a58ff1508+5:2409:x1875730511347328:12345-192.168.201.44@tcp:400:kworker.0 00000100:00100000:0.0:1788836693.870642:0:24573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f50fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f990379c-347e-4ded-be44-9f2a58ff1508+5:2409:x1875730511347328:12345-192.168.201.44@tcp:400:kworker.0 Request processed in 29us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836693.870666:0:24573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 28 00000100:00100000:0.0:1788836693.870678:0:24573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 29 00000100:00100000:0.0:1788836693.870685:0:24573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f50c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:397edcbf-83fc-4215-a82a-1f239b89b4e7+5:2409:x1875730511347840:12345-192.168.201.44@tcp:400:kworker.0 00000100:00100000:0.0:1788836693.870710:0:24573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f50c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:397edcbf-83fc-4215-a82a-1f239b89b4e7+5:2409:x1875730511347840:12345-192.168.201.44@tcp:400:kworker.0 Request processed in 26us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836693.870715:0:24573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 29 00000100:00100000:0.0:1788836693.870725:0:24573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 30 00000100:00100000:0.0:1788836693.870729:0:24573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f50d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f990379c-347e-4ded-be44-9f2a58ff1508+8:2409:x1875730511347200:12345-192.168.201.44@tcp:400:kworker.0 00000100:00100000:0.0:1788836693.870746:0:24573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f50d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f990379c-347e-4ded-be44-9f2a58ff1508+8:2409:x1875730511347200:12345-192.168.201.44@tcp:400:kworker.0 Request processed in 17us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836693.870751:0:24573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 30 00000100:00100000:0.0:1788836693.870760:0:24573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 31 00000100:00100000:0.0:1788836693.870766:0:24573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166d89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:397edcbf-83fc-4215-a82a-1f239b89b4e7+5:2409:x1875730511347712:12345-192.168.201.44@tcp:400:kworker.0 00000100:00100000:0.0:1788836693.870782:0:24573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166d89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:397edcbf-83fc-4215-a82a-1f239b89b4e7+5:2409:x1875730511347712:12345-192.168.201.44@tcp:400:kworker.0 Request processed in 17us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836693.870787:0:24573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 31 00000100:00100000:0.0:1788836693.870946:0:24288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511347072 00000100:00100000:0.0:1788836693.870951:0:24288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511347072 00000100:00100000:0.0:1788836693.870973:0:24288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511347584 00000100:00100000:0.0:1788836693.870976:0:24288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511347584 00000100:00100000:0.0:1788836693.870999:0:24288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511346944 00000100:00100000:0.0:1788836693.871002:0:24288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511346944 00000100:00100000:0.0:1788836693.871013:0:24288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511347456 00000100:00100000:0.0:1788836693.871015:0:24288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511347456 00000100:00100000:0.0:1788836693.871028:0:24288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 76 00000100:00100000:0.0:1788836693.871040:0:24288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f50c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f990379c-347e-4ded-be44-9f2a58ff1508+5:2409:x1875730511347072:12345-192.168.201.44@tcp:400:kworker.0 00000100:00100000:0.0:1788836693.871073:0:24288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f50c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f990379c-347e-4ded-be44-9f2a58ff1508+5:2409:x1875730511347072:12345-192.168.201.44@tcp:400:kworker.0 Request processed in 34us (1081us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836693.871080:0:24288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 76 00000100:00100000:0.0:1788836693.871092:0:24288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 77 00000100:00100000:0.0:1788836693.871098:0:24288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f50e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397edcbf-83fc-4215-a82a-1f239b89b4e7+5:2409:x1875730511347584:12345-192.168.201.44@tcp:400:kworker.0 00000100:00100000:0.0:1788836693.871120:0:24288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f50e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397edcbf-83fc-4215-a82a-1f239b89b4e7+5:2409:x1875730511347584:12345-192.168.201.44@tcp:400:kworker.0 Request processed in 22us (1083us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836693.871125:0:24288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 77 00000100:00100000:0.0:1788836693.871134:0:24288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 78 00000100:00100000:0.0:1788836693.871138:0:24288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f50ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f990379c-347e-4ded-be44-9f2a58ff1508+26:2409:x1875730511346944:12345-192.168.201.44@tcp:400:kworker.0 00000100:00100000:0.0:1788836693.871491:0:24288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f50ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f990379c-347e-4ded-be44-9f2a58ff1508+26:2409:x1875730511346944:12345-192.168.201.44@tcp:400:kworker.0 Request processed in 351us (1409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836693.871497:0:24288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 78 00000100:00100000:0.0:1788836693.871509:0:24288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 79 00000100:00100000:0.0:1788836693.871515:0:24288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8166d8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397edcbf-83fc-4215-a82a-1f239b89b4e7+6:2409:x1875730511347456:12345-192.168.201.44@tcp:400:kworker.0 00000100:00100000:0.0:1788836693.871536:0:24288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8166d8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:397edcbf-83fc-4215-a82a-1f239b89b4e7+6:2409:x1875730511347456:12345-192.168.201.44@tcp:400:kworker.0 Request processed in 22us (1420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788836693.871541:0:24288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 79 00000100:00080000:1.0:1788836693.871846:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788836693.871851:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788836693.871854:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788836693.871856:0:22751:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788836693.872764:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788836693.877084:0:23498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730518807296 00000100:00100000:3.0:1788836693.877101:0:23498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730518807296 00000100:00100000:3.0:1788836693.877653:0:23498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788836693.877667:0:23498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a817f534700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875730518807296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788836693.877707:0:23498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:3.0:1788836693.878623:0:23498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a817f534700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875730518807296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 956us (5857us total) trans 0 rc 0/0 00000100:00100000:3.0:1788836693.878634:0:23498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788836693.879758:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a817f50d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875730518807296:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1788836694.250418:0:22791:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788836694.250429:0:22791:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788836694.250473:0:22791:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1788836694.250484:0:22791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1788836694.382738:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:3.0:1788836694.382791:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.44@tcp (source: 12345-192.168.201.44@tcp) 00000100:00100000:1.0:1788836694.382974:0:24573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511348096 00000100:00100000:1.0:1788836694.382984:0:24573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511348096 00000100:00100000:1.0:1788836694.383048:0:24573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 33 00000100:00100000:1.0:1788836694.383059:0:24573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8048e75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f990379c-347e-4ded-be44-9f2a58ff1508+8:2408:x1875730511348096:12345-192.168.201.44@tcp:16:kworker.0 00000100:00100000:2.0:1788836694.383112:0:24269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875730511347968 00000100:00100000:2.0:1788836694.383118:0:24269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875730511347968 00002000:00100000:2.0:1788836694.383147:0:24269:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x42:0x0] (0->8) req@ffff9a8048e76300 x1875730511347968/t0(0) o4->f990379c-347e-4ded-be44-9f2a58ff1508@192.168.201.44@tcp:105/0 lens 504/0 e 0 to 0 dl 1788836705 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1788836694.383157:0:24269:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8048e76300 with x1875730511347968 ext(0->8) 00002000:00010000:2.0:1788836694.383163:0:24269:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8048e76300 00000100:00100000:2.0:1788836694.383182:0:24269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.44@tcp, seq: 0 00000100:00100000:1.0:1788836694.383187:0:24573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8048e75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f990379c-347e-4ded-be44-9f2a58ff1508+9:2408:x1875730511348096:12345-192.168.201.44@tcp:16:kworker.0 Request processed in 128us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788836694.383195:0:24269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8048e76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f990379c-347e-4ded-be44-9f2a58ff1508+9:2408:x1875730511347968:12345-192.168.201.44@tcp:4:bash.0 00000100:00100000:1.0:1788836694.383202:0:24573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 33 00000100:00100000:2.0:1788836694.389903:0:24269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8048e76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f990379c-347e-4ded-be44-9f2a58ff1508+10:2408:x1875730511347968:12345-192.168.201.44@tcp:4:bash.0 Request processed in 6699us (7161us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1788836694.389919:0:24269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.44@tcp, seq: 0 00002000:00100000:2.0:1788836694.389934:0:24269:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x42:0x0] (0->8) req@ffff9a8048e76300 x1875730511347968/t12884901895(0) o4->f990379c-347e-4ded-be44-9f2a58ff1508@192.168.201.44@tcp:105/0 lens 504/448 e 0 to 0 dl 1788836705 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1788836694.389953:0:24269:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8048e76300 with x1875730511347968 ext(0->8) 00002000:00010000:2.0:1788836694.389960:0:24269:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8048e76300 00010000:00010000:1.0:1788836694.693900:0:22743:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 15299 lines, 15299 kept, 0 dropped, 0 bad.