00010000:00010000:1.0F:1788841217.488527:0:17195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0F:1788841218.061784:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788841218.061823:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7f8f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875735413485056:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788841218.061955:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841218.062043:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413485056 00000100:00100000:3.0:1788841218.062055:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413485056 00000100:00100000:3.0:1788841218.062127:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788841218.062140:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7f8f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875735413485056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788841218.062169:0:18719:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 28672 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788841218.062224:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7f8f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875735413485056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841218.062233:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788841218.062290:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7f8f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875735413485056:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788841218.062603:0:17202:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788841218.062618:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788841218.062629:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47cc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875735413485184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788841218.062666:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841218.062697:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413485184 00000100:00100000:1.0:1788841218.062700:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413485184 00000100:00100000:1.0:1788841218.062732:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788841218.062739:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47cc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3652:x1875735413485184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788841218.062750:0:18719:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 28672 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788841218.062780:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47cc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3652:x1875735413485184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841218.062786:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1788841218.062803:0:17202:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788841218.062825:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47cc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875735413485184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0F:1788841218.063297:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fa05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875735413485568:0@lo:400:kworker.0 00000100:00100000:0.0:1788841218.063350:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841218.063373:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fa05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875735413486080:0@lo:400:kworker.0 00000100:00100000:0.0:1788841218.063411:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841218.063430:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47d4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1875735413486592:0@lo:400:kworker.0 00000100:00100000:0.0:1788841218.063452:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841218.063474:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788841218.063480:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b47841180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875735413485440:0@lo:400:kworker.0 00000100:00100000:0.0:1788841218.063528:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841218.063560:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fa07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875735413485952:0@lo:400:kworker.0 00000100:00100000:0.0:1788841218.063596:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841218.063617:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47d4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1875735413486464:0@lo:400:kworker.0 00000100:00100000:0.0:1788841218.063640:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841218.063671:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413486080 00000100:00100000:0.0:1788841218.063676:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413486080 00000100:00100000:0.0:1788841218.063712:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413486592 00000100:00100000:0.0:1788841218.063715:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413486592 00000100:00100000:0.0:1788841218.063738:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413486464 00000100:00100000:0.0:1788841218.063741:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413486464 00000100:00100000:0.0:1788841218.063758:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788841218.063767:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47d48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875735413486080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841218.063819:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47d48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875735413486080:12345-0@lo:400:kworker.0 Request processed in 52us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841218.063826:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788841218.063870:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788841218.063877:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47d48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875735413486592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841218.063906:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47d48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875735413486592:12345-0@lo:400:kworker.0 Request processed in 30us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841218.063920:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788841218.063934:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788841218.063940:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b81c9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875735413486464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841218.063970:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b81c9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875735413486464:12345-0@lo:400:kworker.0 Request processed in 30us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841218.063976:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788841218.063998:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413485440 00000100:00100000:0.0:1788841218.064002:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413485440 00000100:00100000:0.0:1788841218.064029:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788841218.064035:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b81c9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875735413485440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841218.064071:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b81c9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875735413485440:12345-0@lo:400:kworker.0 Request processed in 37us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841218.064078:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788841218.064097:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413485568 00000100:00100000:0.0:1788841218.064101:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413485568 00000100:00100000:0.0:1788841218.064125:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413485952 00000100:00100000:0.0:1788841218.064128:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413485952 00000100:00100000:0.0:1788841218.064144:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788841218.064150:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47d4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875735413485568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841218.064184:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47d4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875735413485568:12345-0@lo:400:kworker.0 Request processed in 33us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841218.064189:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788841218.064200:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788841218.064205:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b81c9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875735413485952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841218.064231:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b81c9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875735413485952:12345-0@lo:400:kworker.0 Request processed in 26us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841218.064246:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1788841218.064275:0:17202:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788841218.064280:0:17202:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788841218.064282:0:17202:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788841218.064295:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b47840700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ab398079-8cf9-457a-bcc0-cfc99d2f260b:3652:1875735413485312:0@lo:400:kworker.0 00000100:00100000:0.0:1788841218.064331:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841218.064362:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fa04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875735413485824:0@lo:400:kworker.0 00000100:00100000:0.0:1788841218.064399:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841218.064416:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a46b0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1875735413486336:0@lo:400:kworker.0 00000100:00100000:0.0:1788841218.064438:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841218.064458:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788841218.064464:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fa07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875735413485696:0@lo:400:kworker.0 00000100:00100000:0.0:1788841218.064486:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841218.064503:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a46b0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1875735413486208:0@lo:400:kworker.0 00000100:00100000:0.0:1788841218.064525:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841218.064548:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413485312 00000100:00100000:0.0:1788841218.064553:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413485312 00000100:00100000:0.0:1788841218.064583:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788841218.064590:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47ee5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab398079-8cf9-457a-bcc0-cfc99d2f260b+24:3652:x1875735413485312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841218.064626:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47ee5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab398079-8cf9-457a-bcc0-cfc99d2f260b+24:3652:x1875735413485312:12345-0@lo:400:kworker.0 Request processed in 36us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841218.064633:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788841218.064668:0:20345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413486336 00000100:00100000:0.0:1788841218.064672:0:20345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413486336 00000100:00100000:0.0:1788841218.064696:0:20345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413485696 00000100:00100000:0.0:1788841218.064699:0:20345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413485696 00000100:00100000:0.0:1788841218.064720:0:20345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413486208 00000100:00100000:0.0:1788841218.064723:0:20345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413486208 00000100:00100000:0.0:1788841218.064738:0:20345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788841218.064743:0:20345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b81c9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875735413486336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841218.064773:0:20345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b81c9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875735413486336:12345-0@lo:400:kworker.0 Request processed in 29us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841218.064779:0:20345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788841218.064791:0:20345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788841218.064797:0:20345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b81c9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875735413485696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841218.064823:0:20345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b81c9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875735413485696:12345-0@lo:400:kworker.0 Request processed in 27us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841218.064830:0:20345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788841218.064871:0:20345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788841218.064877:0:20345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b81c9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875735413486208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841218.064907:0:20345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b81c9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875735413486208:12345-0@lo:400:kworker.0 Request processed in 30us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841218.064912:0:20345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:0.0:1788841218.064927:0:17202:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788841218.064930:0:17202:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788841218.064972:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fa07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875735413485696:0@lo:400:kworker.0 00000100:00100000:0.0:1788841218.064984:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a46b0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1875735413486208:0@lo:400:kworker.0 00000100:00100000:0.0:1788841218.064992:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b47840700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ab398079-8cf9-457a-bcc0-cfc99d2f260b:3652:1875735413485312:0@lo:400:kworker.0 00010000:00080000:0.0:1788841218.065007:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa04a46b0d880 x1875735413486336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841218.065018:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a46b0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1875735413486336:0@lo:400:kworker.0 00000100:00100000:0.0:1788841218.065072:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b47841180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875735413485440:0@lo:400:kworker.0 00000100:00100000:0.0:1788841218.065086:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fa07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875735413485952:0@lo:400:kworker.0 00000100:00100000:0.0:1788841218.065098:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47d4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1875735413486464:0@lo:400:kworker.0 00000100:00100000:0.0:1788841218.065110:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fa05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875735413485568:0@lo:400:kworker.0 00000100:00100000:0.0:1788841218.065121:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fa05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875735413486080:0@lo:400:kworker.0 00010000:00080000:0.0:1788841218.065133:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa04a47d4bb80 x1875735413486592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841218.065142:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47d4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1875735413486592:0@lo:400:kworker.0 00000100:00100000:3.0:1788841218.065282:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413485824 00000100:00100000:3.0:1788841218.065287:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413485824 00000100:00100000:3.0:1788841218.065330:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788841218.065340:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b81c9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875735413485824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841218.065409:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b81c9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875735413485824:12345-0@lo:400:kworker.0 Request processed in 71us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841218.065416:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0F:1788841218.065423:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fa04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875735413485824:0@lo:400:kworker.0 00010000:00010000:1.0:1788841218.512511:0:17960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788841218.579195:0:17186:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934635 is committed 00000020:00080000:1.0:1788841218.579305:0:17186:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa04b473da0c0 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:1.0:1788841218.579313:0:17186:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa04b710c6400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa04b473da900 00000020:00080000:1.0:1788841218.579317:0:17186:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa04b710c6600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa04b76059600 00000020:00080000:3.0:1788841218.579395:0:17246:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00000020:00080000:3.0:1788841218.579510:0:17246:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1788841218.579773:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa04a474af000/0x5757cd208ac37fa9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841218.579790:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa04a474af000/0x5757cd208ac37fa9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841218.579799:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa04a474af000/0x5757cd208ac37fa9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841218.579806:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a474af000 already unused, calling callback (ffffffffc17b44f0) 00010000:00010000:2.0:1788841218.579811:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04a474af000/0x5757cd208ac37fa9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841218.579822:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04a474af000/0x5757cd208ac37fa9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841218.579903:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa04b558f7800) 00010000:00010000:2.0:1788841218.579908:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788841218.579915:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa04a474af000/0x5757cd208ac37fa9 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841218.579923:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04a474af000/0x5757cd208ac37fa9 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20345 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788841218.580211:0:19528:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:3.0:1788841218.580301:0:19528:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000100:00100000:0.0:1788841219.484825:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:0.0:1788841219.484907:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:0.0:1788841219.484948:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392435840 00000100:00100000:0.0:1788841219.484961:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392435840 00000100:00100000:0.0:1788841219.485032:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 169 00000100:00100000:0.0:1788841219.485045:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47ee5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1601f4c1-9799-4f1d-845e-9f3347550705+13:2401:x1875735392435840:12345-192.168.204.7@tcp:400:kworker.0 00000100:00100000:0.0:1788841219.485142:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47ee5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1601f4c1-9799-4f1d-845e-9f3347550705+13:2401:x1875735392435840:12345-192.168.204.7@tcp:400:kworker.0 Request processed in 99us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841219.485150:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 169 00000100:00100000:0.0:1788841219.485196:0:20345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392436096 00000100:00100000:0.0:1788841219.485200:0:20345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392436096 00000100:00080000:1.0:1788841219.486116:0:17202:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788841219.487877:0:20345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 72 00000100:00100000:0.0:1788841219.487907:0:20345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b81c9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d9869f3a-61f0-4dde-ae0a-6fe2d2b9a51b+5:2401:x1875735392436096:12345-192.168.204.7@tcp:400:kworker.0 00000100:00100000:0.0:1788841219.488049:0:20345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b81c9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d9869f3a-61f0-4dde-ae0a-6fe2d2b9a51b+5:2401:x1875735392436096:12345-192.168.204.7@tcp:400:kworker.0 Request processed in 158us (3142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841219.488072:0:20345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 72 00000100:00100000:0.0:1788841219.493983:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:0.0:1788841219.494040:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392435968 00000100:00100000:0.0:1788841219.494054:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392435968 00000100:00100000:0.0:1788841219.494140:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 73 00000100:00100000:0.0:1788841219.494154:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b81c9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d9869f3a-61f0-4dde-ae0a-6fe2d2b9a51b+12:2401:x1875735392435968:12345-192.168.204.7@tcp:400:kworker.0 00000100:00100000:0.0:1788841219.494257:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b81c9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d9869f3a-61f0-4dde-ae0a-6fe2d2b9a51b+12:2401:x1875735392435968:12345-192.168.204.7@tcp:400:kworker.0 Request processed in 105us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841219.494265:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 73 00000100:00080000:1.0:1788841219.494432:0:17202:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788841219.507976:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:1.0:1788841219.508015:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:1.0:1788841219.508044:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:1.0:1788841219.508096:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:1.0:1788841219.508122:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:1.0:1788841219.508241:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:1.0:1788841219.508289:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392436224 00000100:00100000:1.0:1788841219.508302:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392436224 00000100:00100000:1.0:1788841219.508377:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392436352 00000100:00100000:1.0:1788841219.508381:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392436352 00000100:00100000:1.0:1788841219.508400:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392436736 00000100:00100000:1.0:1788841219.508402:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392436736 00000100:00100000:1.0:1788841219.508414:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392436864 00000100:00100000:1.0:1788841219.508416:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392436864 00000100:00100000:1.0:1788841219.508433:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 32 00000100:00100000:1.0:1788841219.508444:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47cc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d9869f3a-61f0-4dde-ae0a-6fe2d2b9a51b+6:2400:x1875735392436352:12345-192.168.204.7@tcp:400:kworker.0 00000100:00100000:1.0:1788841219.511287:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47cc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d9869f3a-61f0-4dde-ae0a-6fe2d2b9a51b+6:2400:x1875735392436352:12345-192.168.204.7@tcp:400:kworker.0 Request processed in 2827us (3252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841219.511306:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 32 00000100:00100000:1.0:1788841219.511368:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 32 00000100:00100000:1.0:1788841219.511385:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47cc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d9869f3a-61f0-4dde-ae0a-6fe2d2b9a51b+5:2399:x1875735392436224:12345-192.168.204.7@tcp:9:kworker.0 00000020:00000080:1.0:1788841219.511418:0:18715:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac37c61 00000100:00080000:1.0:1788841219.512278:0:18715:0:(import.c:65:import_set_state_nolock()) ffffa04b7f86e800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788841219.512374:0:18715:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1788841219.512866:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47cc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d9869f3a-61f0-4dde-ae0a-6fe2d2b9a51b+2:2399:x1875735392436224:12345-192.168.204.7@tcp:9:kworker.0 Request processed in 1482us (4901us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841219.512878:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 32 00000100:00100000:1.0:1788841219.512912:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 33 00000100:00100000:1.0:1788841219.512926:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47d43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:05b5e23c-fb41-484b-af6b-585a3a9027d2+5:2399:x1875735392436736:12345-192.168.204.7@tcp:9:kworker.0 00000020:00000080:1.0:1788841219.512961:0:18715:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac37ca0 00000100:00080000:1.0:1788841219.512973:0:18715:0:(import.c:65:import_set_state_nolock()) ffffa04a4745d800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788841219.513006:0:18715:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1788841219.513074:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47d43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:05b5e23c-fb41-484b-af6b-585a3a9027d2+2:2399:x1875735392436736:12345-192.168.204.7@tcp:9:kworker.0 Request processed in 152us (4949us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841219.513097:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 33 00000100:00100000:1.0:1788841219.513112:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 34 00000100:00100000:1.0:1788841219.513120:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47d42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:05b5e23c-fb41-484b-af6b-585a3a9027d2+5:2399:x1875735392436864:12345-192.168.204.7@tcp:9:kworker.0 00000020:00000080:1.0:1788841219.513134:0:18715:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac37ca7 00000100:00080000:1.0:1788841219.513142:0:18715:0:(import.c:65:import_set_state_nolock()) ffffa04b47816800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788841219.513168:0:18715:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:1.0:1788841219.513244:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47d42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:05b5e23c-fb41-484b-af6b-585a3a9027d2+2:2399:x1875735392436864:12345-192.168.204.7@tcp:9:kworker.0 Request processed in 126us (5004us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841219.513252:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 34 00000100:00100000:1.0:1788841219.513280:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392436480 00000100:00100000:1.0:1788841219.513289:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392436480 00000100:00100000:1.0:1788841219.513336:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392436608 00000100:00100000:1.0:1788841219.513339:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392436608 00000100:00100000:1.0:1788841219.513385:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 74 00000100:00100000:1.0:1788841219.513392:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47cc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:05b5e23c-fb41-484b-af6b-585a3a9027d2+6:2400:x1875735392436480:12345-192.168.204.7@tcp:400:kworker.0 00000100:00100000:1.0:1788841219.513423:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47cc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:05b5e23c-fb41-484b-af6b-585a3a9027d2+6:2400:x1875735392436480:12345-192.168.204.7@tcp:400:kworker.0 Request processed in 32us (5378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841219.513430:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 74 00000100:00100000:1.0:1788841219.513441:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 75 00000100:00100000:1.0:1788841219.513447:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47d41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:05b5e23c-fb41-484b-af6b-585a3a9027d2+5:2400:x1875735392436608:12345-192.168.204.7@tcp:400:kworker.0 00000100:00100000:1.0:1788841219.513479:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47d41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:05b5e23c-fb41-484b-af6b-585a3a9027d2+5:2400:x1875735392436608:12345-192.168.204.7@tcp:400:kworker.0 Request processed in 33us (5384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841219.513485:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 75 00010000:00010000:0.0:1788841219.514570:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841219.517866:0:17960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841219.517883:0:17195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788841219.522285:0:17202:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788841219.522301:0:17202:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788841219.522306:0:17202:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788841219.522310:0:17202:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788841219.533082:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841220.109088:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7f8f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875735413486720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788841220.109210:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841220.109315:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413486720 00000100:00100000:3.0:1788841220.109325:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413486720 00000100:00100000:3.0:1788841220.109406:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788841220.109431:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7f8f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875735413486720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788841220.109469:0:18719:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788841220.109525:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7f8f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875735413486720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841220.109533:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1788841220.109558:0:17202:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788841220.109609:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7f8f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875735413486720:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788841220.558015:0:17960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841220.580399:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:0.0:1788841220.580710:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392436992 00000100:00100000:0.0:1788841220.580725:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392436992 00000100:00100000:0.0:1788841220.580816:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 74 00000100:00100000:0.0:1788841220.580829:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7f8f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d9869f3a-61f0-4dde-ae0a-6fe2d2b9a51b+12:15609:x1875735392436992:12345-192.168.204.7@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788841220.581001:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7f8f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d9869f3a-61f0-4dde-ae0a-6fe2d2b9a51b+12:15609:x1875735392436992:12345-192.168.204.7@tcp:60:lhsmtool_posix.0 Request processed in 174us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841220.581009:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 74 00000100:00100000:3.0:1788841220.583025:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:0.0:1788841220.583245:0:20345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392437120 00000100:00100000:0.0:1788841220.583256:0:20345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392437120 00000100:00100000:0.0:1788841220.583329:0:20345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 75 00000100:00100000:0.0:1788841220.583355:0:20345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7f8f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d9869f3a-61f0-4dde-ae0a-6fe2d2b9a51b+5:15609:x1875735392437120:12345-192.168.204.7@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788841220.583512:0:20345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7f8f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d9869f3a-61f0-4dde-ae0a-6fe2d2b9a51b+5:15609:x1875735392437120:12345-192.168.204.7@tcp:60:lhsmtool_posix.0 Request processed in 162us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841220.583534:0:20345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 75 00000100:00100000:0.0:1788841220.586089:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:3.0:1788841220.586235:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392437376 00000100:00100000:3.0:1788841220.586250:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392437376 00000100:00100000:3.0:1788841220.586333:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 16 00000100:00100000:3.0:1788841220.586356:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7fcb2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d9869f3a-61f0-4dde-ae0a-6fe2d2b9a51b+12:15609:x1875735392437376:12345-192.168.204.7@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788841220.586691:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7fcb2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d9869f3a-61f0-4dde-ae0a-6fe2d2b9a51b+13:15609:x1875735392437376:12345-192.168.204.7@tcp:35:lhsmtool_posix.0 Request processed in 336us (618us total) trans 8589934636 rc 0/0 00000100:00100000:3.0:1788841220.586702:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 16 00000100:00100000:0.0:1788841221.133476:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788841221.133508:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b81c9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875735413486976:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788841221.133594:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841221.133655:0:18209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413486976 00000100:00100000:0.0:1788841221.133665:0:18209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413486976 00000100:00100000:0.0:1788841221.133718:0:18209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788841221.133728:0:18209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b81c9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875735413486976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788841221.133763:0:18209:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788841221.133817:0:18209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b81c9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875735413486976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841221.133826:0:18209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788841221.134105:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47d40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875735413487104:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788841221.134148:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841221.134203:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b81c9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875735413486976:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788841221.134246:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413487104 00000100:00100000:1.0:1788841221.134250:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413487104 00000100:00100000:1.0:1788841221.134274:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788841221.134281:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47d42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875735413487104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788841221.134301:0:17211:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1788841221.134361:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47d42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875735413487104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841221.134368:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788841221.134413:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47d40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875735413487104:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788841221.139646:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b527ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875735413486848:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788841221.139765:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841221.140562:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413486848 00000100:00100000:1.0:1788841221.140580:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413486848 00000100:00100000:1.0:1788841221.140758:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788841221.140773:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7f8f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875735413486848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788841221.140816:0:18719:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788841221.140974:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7f8f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875735413486848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 204us (1207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841221.140982:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788841221.143190:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b527ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875735413486848:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788841221.151509:0:17202:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1788841221.327412:0:17242:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788841221.327427:0:17242:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788841221.327658:0:17242:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788841221.327671:0:17242:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788841221.581160:0:17195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841222.607324:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788841223.181589:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7f8f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875735413487232:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788841223.181729:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841223.181983:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413487232 00000100:00100000:3.0:1788841223.181995:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413487232 00000100:00100000:3.0:1788841223.182084:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788841223.182122:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b81c9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875735413487232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788841223.182176:0:18719:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788841223.182234:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b81c9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875735413487232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 117us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841223.182242:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1788841223.182994:0:17202:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788841223.183061:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7f8f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875735413487232:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788841223.183823:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b527baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875735413487488:0@lo:400:kworker.0 00000100:00100000:2.0:1788841223.184049:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841223.184101:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b491d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875735413488000:0@lo:400:kworker.0 00000100:00100000:2.0:1788841223.184126:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841223.184619:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413487488 00000100:00100000:1.0:1788841223.184629:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413487488 00000100:00100000:1.0:1788841223.184699:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413488000 00000100:00100000:1.0:1788841223.184702:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413488000 00000100:00100000:1.0:1788841223.184722:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788841223.184732:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b491d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875735413487488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841223.184824:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b491d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875735413487488:12345-0@lo:400:kworker.0 Request processed in 92us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841223.184854:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788841223.184879:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788841223.184885:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b491d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875735413488000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841223.184921:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b491d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875735413488000:12345-0@lo:400:kworker.0 Request processed in 36us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841223.184927:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788841223.184949:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b527ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ab398079-8cf9-457a-bcc0-cfc99d2f260b:3652:1875735413487360:0@lo:400:kworker.0 00000100:00100000:1.0:1788841223.184987:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841223.185021:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b527bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875735413487872:0@lo:400:kworker.0 00000100:00100000:1.0:1788841223.185064:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841223.185086:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b491d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1875735413488384:0@lo:400:kworker.0 00000100:00100000:1.0:1788841223.185107:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841223.185121:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47d40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875735413488896:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788841223.185583:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413487872 00000100:00100000:3.0:1788841223.185602:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413487872 00000100:00100000:3.0:1788841223.185648:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413488384 00000100:00100000:3.0:1788841223.185651:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413488384 00000100:00100000:3.0:1788841223.185680:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788841223.185688:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47d43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875735413487872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841223.185760:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47d43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875735413487872:12345-0@lo:400:kworker.0 Request processed in 74us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841223.185768:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788841223.185783:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788841223.185790:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47d41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875735413488384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841223.185817:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47d41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875735413488384:12345-0@lo:400:kworker.0 Request processed in 28us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841223.185823:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788841223.185868:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b527bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875735413487744:0@lo:400:kworker.0 00000100:00100000:3.0:1788841223.185900:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841223.185928:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b491d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875735413488256:0@lo:400:kworker.0 00000100:00100000:3.0:1788841223.185951:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841223.185968:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b491d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875735413488768:0@lo:400:kworker.0 00000100:00100000:3.0:1788841223.185990:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841223.186021:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413487744 00000100:00100000:3.0:1788841223.186052:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413487744 00000100:00100000:3.0:1788841223.186089:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788841223.186096:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7f8f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875735413487744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841223.186133:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7f8f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875735413487744:12345-0@lo:400:kworker.0 Request processed in 39us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841223.186140:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788841223.186387:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b491d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1875735413488512:0@lo:400:kworker.0 00000100:00100000:2.0:1788841223.186421:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841223.186473:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b527baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875735413487488:0@lo:400:kworker.0 00000100:00100000:2.0:1788841223.186487:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b491d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875735413488000:0@lo:400:kworker.0 00000100:00100000:2.0:1788841223.186514:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788841223.186521:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b527b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875735413487616:0@lo:400:kworker.0 00000100:00100000:2.0:1788841223.186545:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841223.186565:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b491d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875735413488128:0@lo:400:kworker.0 00000100:00100000:2.0:1788841223.186585:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841223.186602:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b491d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1875735413488640:0@lo:400:kworker.0 00000100:00100000:2.0:1788841223.186624:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841223.186648:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413487616 00000100:00100000:2.0:1788841223.186652:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413487616 00000100:00100000:2.0:1788841223.186675:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413488128 00000100:00100000:2.0:1788841223.186678:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413488128 00000100:00100000:2.0:1788841223.186693:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788841223.186699:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b491d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875735413487616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841223.186905:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841223.186957:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b527bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875735413487872:0@lo:400:kworker.0 00000100:00100000:1.0:1788841223.186971:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b491d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1875735413488384:0@lo:400:kworker.0 00000100:00100000:1.0:1788841223.187001:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413487360 00000100:00100000:1.0:1788841223.187005:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413487360 00000100:00100000:1.0:1788841223.187051:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788841223.187067:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47ee7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab398079-8cf9-457a-bcc0-cfc99d2f260b+24:3652:x1875735413487360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841223.187108:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47ee7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab398079-8cf9-457a-bcc0-cfc99d2f260b+24:3652:x1875735413487360:12345-0@lo:400:kworker.0 Request processed in 41us (2120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841223.187115:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788841223.187897:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788841223.187909:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b491d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875735413488128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841223.187971:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b491d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875735413488128:12345-0@lo:400:kworker.0 Request processed in 66us (1385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841223.187977:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788841223.188007:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413488256 00000100:00100000:3.0:1788841223.188014:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413488256 00000100:00100000:3.0:1788841223.188039:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413488768 00000100:00100000:3.0:1788841223.188042:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413488768 00000100:00100000:3.0:1788841223.188058:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413488512 00000100:00100000:3.0:1788841223.188060:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413488512 00000100:00100000:3.0:1788841223.188070:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413488640 00000100:00100000:3.0:1788841223.188073:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413488640 00000100:00100000:3.0:1788841223.188087:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788841223.188092:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7f8f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875735413488256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841223.188122:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7f8f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875735413488256:12345-0@lo:400:kworker.0 Request processed in 30us (2171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841223.188128:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788841223.188138:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788841223.188460:0:20345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788841223.188473:0:20345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b491d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875735413488512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841223.188521:0:20345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b491d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875735413488512:12345-0@lo:400:kworker.0 Request processed in 52us (2098us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841223.188529:0:20345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788841223.188563:0:20345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788841223.188569:0:20345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b491d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875735413488640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841223.188610:0:20345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b491d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875735413488640:12345-0@lo:400:kworker.0 Request processed in 42us (1985us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841223.188617:0:20345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:0.0:1788841223.188667:0:17202:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788841223.188673:0:17202:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788841223.188687:0:17202:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788841223.188691:0:17202:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788841223.188791:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b491d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875735413487616:12345-0@lo:400:kworker.0 Request processed in 2089us (2242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841223.188800:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788841223.188887:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b527b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875735413487616:0@lo:400:kworker.0 00000100:00100000:2.0:1788841223.188905:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b491d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875735413488128:0@lo:400:kworker.0 00000100:00100000:2.0:1788841223.188916:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b491d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1875735413488640:0@lo:400:kworker.0 00010000:00080000:2.0:1788841223.188932:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa04b491d1500 x1875735413488512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841223.188943:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b491d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1875735413488512:0@lo:400:kworker.0 00000100:00100000:2.0:1788841223.189028:0:3651:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:2.0:1788841223.189036:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa04b7f8f4000, transno 8589934596 00000004:00080000:2.0:1788841223.189071:0:3651:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:2.0:1788841223.189093:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b527bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875735413487744:0@lo:400:kworker.0 00000100:00100000:2.0:1788841223.189106:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b491d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875735413488256:0@lo:400:kworker.0 00000100:00100000:3.0:1788841223.189484:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7f8f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875735413488768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841223.189557:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7f8f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875735413488768:12345-0@lo:400:kworker.0 Request processed in 1413us (3567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841223.189577:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788841223.192946:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413488896 00000100:00100000:0.0:1788841223.192972:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413488896 00000100:00100000:0.0:1788841223.193083:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788841223.193095:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47d42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875735413488896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788841223.193136:0:18719:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788841223.193265:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47d42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875735413488896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 172us (6360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841223.193273:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788841223.193370:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b527ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ab398079-8cf9-457a-bcc0-cfc99d2f260b:3652:1875735413487360:0@lo:400:kworker.0 00000100:00100000:0.0:1788841223.193401:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47d40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875735413488896:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788841223.194550:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa04b491d3b80 x1875735413488768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841223.194570:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b491d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875735413488768:0@lo:400:kworker.0 00010000:00010000:0.0:1788841223.631109:0:17960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788841224.597036:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:0.0:1788841224.597087:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:0.0:1788841224.597119:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:0.0:1788841224.597144:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:0.0:1788841224.597169:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:0.0:1788841224.597197:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:0.0:1788841224.597234:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392437760 00000100:00100000:0.0:1788841224.597255:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392437760 00000100:00100000:0.0:1788841224.597336:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392438016 00000100:00100000:0.0:1788841224.597339:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392438016 00000100:00100000:0.0:1788841224.597352:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392437632 00000100:00100000:0.0:1788841224.597354:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392437632 00000100:00100000:0.0:1788841224.597369:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392438144 00000100:00100000:0.0:1788841224.597371:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392438144 00000100:00100000:0.0:1788841224.597389:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 82 00000100:00100000:0.0:1788841224.597401:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b81c9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d9869f3a-61f0-4dde-ae0a-6fe2d2b9a51b+5:2401:x1875735392437760:12345-192.168.204.7@tcp:400:kworker.0 00000100:00100000:0.0:1788841224.597501:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b81c9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d9869f3a-61f0-4dde-ae0a-6fe2d2b9a51b+5:2401:x1875735392437760:12345-192.168.204.7@tcp:400:kworker.0 Request processed in 101us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841224.597509:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 82 00000100:00100000:0.0:1788841224.597529:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 83 00000100:00100000:0.0:1788841224.597536:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b81c9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:05b5e23c-fb41-484b-af6b-585a3a9027d2+6:2401:x1875735392438016:12345-192.168.204.7@tcp:400:kworker.0 00000100:00100000:0.0:1788841224.597562:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b81c9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:05b5e23c-fb41-484b-af6b-585a3a9027d2+6:2401:x1875735392438016:12345-192.168.204.7@tcp:400:kworker.0 Request processed in 26us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841224.597568:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 83 00000100:00100000:0.0:1788841224.597580:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 84 00000100:00100000:0.0:1788841224.597586:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b81c9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d9869f3a-61f0-4dde-ae0a-6fe2d2b9a51b+13:2401:x1875735392437632:12345-192.168.204.7@tcp:400:kworker.0 00000100:00100000:0.0:1788841224.597616:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b81c9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d9869f3a-61f0-4dde-ae0a-6fe2d2b9a51b+13:2401:x1875735392437632:12345-192.168.204.7@tcp:400:kworker.0 Request processed in 30us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841224.597623:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 84 00000100:00100000:0.0:1788841224.597634:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 85 00000100:00100000:0.0:1788841224.597639:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b81c9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:05b5e23c-fb41-484b-af6b-585a3a9027d2+5:2401:x1875735392438144:12345-192.168.204.7@tcp:400:kworker.0 00000100:00100000:0.0:1788841224.597662:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b81c9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:05b5e23c-fb41-484b-af6b-585a3a9027d2+5:2401:x1875735392438144:12345-192.168.204.7@tcp:400:kworker.0 Request processed in 22us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841224.597677:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 85 00000100:00100000:0.0:1788841224.597704:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392437888 00000100:00100000:0.0:1788841224.597708:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392437888 00000100:00100000:0.0:1788841224.597738:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 36 00000100:00100000:0.0:1788841224.597745:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b81c9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d9869f3a-61f0-4dde-ae0a-6fe2d2b9a51b+6:2401:x1875735392437888:12345-192.168.204.7@tcp:400:kworker.0 00000100:00100000:0.0:1788841224.597773:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b81c9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d9869f3a-61f0-4dde-ae0a-6fe2d2b9a51b+6:2401:x1875735392437888:12345-192.168.204.7@tcp:400:kworker.0 Request processed in 29us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841224.597779:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 36 00000100:00080000:0.0:1788841224.597796:0:17202:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788841224.597802:0:17202:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788841224.597804:0:17202:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788841224.598095:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392437504 00000100:00100000:1.0:1788841224.598100:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392437504 00000100:00100000:1.0:1788841224.598135:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 171 00000100:00100000:1.0:1788841224.598142:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47ee6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1601f4c1-9799-4f1d-845e-9f3347550705+13:2401:x1875735392437504:12345-192.168.204.7@tcp:400:kworker.0 00000100:00100000:1.0:1788841224.598184:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47ee6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1601f4c1-9799-4f1d-845e-9f3347550705+13:2401:x1875735392437504:12345-192.168.204.7@tcp:400:kworker.0 Request processed in 43us (1165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841224.598190:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 171 00010000:00010000:1.0:1788841224.653496:0:17195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788841224.720188:0:17186:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934636 is committed 00000020:00080000:3.0:1788841224.720212:0:17186:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:3.0:1788841224.720238:0:17246:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:3.0:1788841224.720254:0:17246:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000001:02000400:3.0:1788841225.145242:0:20581:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 00:20:22 (1788841222) 00000100:00100000:0.0:1788841225.236659:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47d41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875735413489024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788841225.236781:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841225.237084:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413489024 00000100:00100000:1.0:1788841225.237097:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413489024 00000100:00100000:1.0:1788841225.237198:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788841225.237210:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b81c9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875735413489024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788841225.237265:0:18719:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788841225.237335:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b81c9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875735413489024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841225.237343:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1788841225.237663:0:17202:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788841225.243334:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47d41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875735413489024:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788841225.678266:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788841225.749912:0:19528:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 05b5e23c-fb41-484b-af6b-585a3a9027d2 00000020:00000080:1.0:1788841225.749927:0:19528:0:(genops.c:885:class_export_put()) final put ffffa04b47817000/05b5e23c-fb41-484b-af6b-585a3a9027d2 00000020:00000080:0.0:1788841225.750038:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b47817000/05b5e23c-fb41-484b-af6b-585a3a9027d2 for lustre-OST0001 00000020:00000080:0.0:1788841225.751511:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa04b47816800 for lustre-OST0001 00000001:00100000:0.0:1788841225.755605:0:18711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 05b5e23c-fb41-484b-af6b-585a3a9027d2 00000020:00000080:0.0:1788841225.755620:0:18711:0:(genops.c:885:class_export_put()) final put ffffa04a47459000/05b5e23c-fb41-484b-af6b-585a3a9027d2 00000001:00100000:0.0:1788841225.755656:0:18711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d9869f3a-61f0-4dde-ae0a-6fe2d2b9a51b 00000020:00000080:0.0:1788841225.755660:0:18711:0:(genops.c:885:class_export_put()) final put ffffa04b7f868800/d9869f3a-61f0-4dde-ae0a-6fe2d2b9a51b 00000020:00000080:1.0:1788841225.757554:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa04a47459000/05b5e23c-fb41-484b-af6b-585a3a9027d2 for lustre-OST0000 00000020:00000080:1.0:1788841225.761100:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b7f868800/d9869f3a-61f0-4dde-ae0a-6fe2d2b9a51b for lustre-OST0000 00000020:00000080:1.0:1788841225.761264:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa04a4745d800 for lustre-OST0000 00000020:00000080:1.0:1788841225.761271:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa04b7f86e800 for lustre-OST0000 00000100:00100000:2.0:1788841226.253152:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47d41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875735413489152:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788841226.253280:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841226.253496:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413489152 00000100:00100000:1.0:1788841226.253508:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413489152 00000100:00100000:0.0:1788841226.253541:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788841226.253568:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b81c9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875735413489280:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788841226.253597:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788841226.253613:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b491d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875735413489152:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788841226.253657:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:1.0:1788841226.253670:0:17211:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1788841226.253744:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b491d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875735413489152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 134us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841226.253751:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788841226.253767:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413489280 00000100:00100000:1.0:1788841226.253771:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413489280 00000100:00100000:1.0:1788841226.253791:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788841226.253806:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47d4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875735413489280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788841226.253868:0:17211:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788841226.253917:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47d4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875735413489280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841226.253924:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788841226.253984:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b81c9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875735413489280:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788841226.253989:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47d41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875735413489152:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788841226.254180:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788841226.254193:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b491d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875735413489408:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788841226.254240:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841226.254417:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413489408 00000100:00100000:1.0:1788841226.254422:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413489408 00000100:00100000:1.0:1788841226.254493:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788841226.254502:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b491d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875735413489408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788841226.254520:0:18719:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788841226.254569:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b491d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875735413489408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841226.254575:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788841226.254627:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b491d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875735413489408:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788841226.254784:0:17202:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1788841226.391695:0:17962:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788841226.702703:0:17960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841227.725777:0:17195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788841228.301489:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7f8f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875735413489536:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788841228.301580:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841228.302101:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7f8f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ab398079-8cf9-457a-bcc0-cfc99d2f260b:3650:1875735413489664:0@lo:400:kworker.0 00000100:00100000:0.0:1788841228.302146:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841228.302196:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47b44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875735413490176:0@lo:400:kworker.0 00000100:00100000:0.0:1788841228.302223:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841228.302243:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1875735413490688:0@lo:400:kworker.0 00000100:00100000:0.0:1788841228.302390:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841228.302413:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788841228.302419:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7f9c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875735413490048:0@lo:400:kworker.0 00000100:00100000:0.0:1788841228.302446:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841228.302464:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875735413490560:0@lo:400:kworker.0 00000100:00100000:0.0:1788841228.302485:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841228.302500:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1875735413491072:0@lo:400:kworker.0 00000100:00100000:0.0:1788841228.302517:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841228.302539:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47cbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875735413489920:0@lo:400:kworker.0 00000100:00100000:0.0:1788841228.302557:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841228.302570:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47b45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875735413490432:0@lo:400:kworker.0 00000100:00100000:0.0:1788841228.302587:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841228.302598:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7f84c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1875735413490944:0@lo:400:kworker.0 00000100:00100000:0.0:1788841228.302614:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841228.302623:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788841228.302628:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47c45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875735413489792:0@lo:400:kworker.0 00000100:00100000:0.0:1788841228.302646:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841228.302660:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875735413490304:0@lo:400:kworker.0 00000100:00100000:0.0:1788841228.302688:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841228.302701:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7f84ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1875735413490816:0@lo:400:kworker.0 00000100:00100000:0.0:1788841228.302716:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841228.302863:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413490176 00000100:00100000:0.0:1788841228.302871:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413490176 00000100:00100000:0.0:1788841228.302911:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413490688 00000100:00100000:0.0:1788841228.302914:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413490688 00000100:00100000:0.0:1788841228.302934:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413490560 00000100:00100000:0.0:1788841228.302936:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413490560 00000100:00100000:0.0:1788841228.302944:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413491072 00000100:00100000:0.0:1788841228.302946:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413491072 00000100:00100000:0.0:1788841228.302956:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413490944 00000100:00100000:0.0:1788841228.302957:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413490944 00000100:00100000:0.0:1788841228.302967:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413490816 00000100:00100000:0.0:1788841228.302969:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413490816 00000100:00100000:0.0:1788841228.302982:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788841228.302990:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47d4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875735413490176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841228.303039:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47d4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875735413490176:12345-0@lo:400:kworker.0 Request processed in 50us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841228.303046:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788841228.303201:0:19184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413490048 00000100:00100000:2.0:1788841228.303205:0:19184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413490048 00000100:00100000:2.0:1788841228.303235:0:19184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413489920 00000100:00100000:2.0:1788841228.303239:0:19184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413489920 00000100:00100000:2.0:1788841228.303251:0:19184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413490432 00000100:00100000:2.0:1788841228.303264:0:19184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413490432 00000100:00100000:2.0:1788841228.303280:0:19184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788841228.303287:0:19184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b47843b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875735413490048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841228.303323:0:19184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b47843b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875735413490048:12345-0@lo:400:kworker.0 Request processed in 36us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841228.303339:0:19184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788841228.303352:0:19184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788841228.303358:0:19184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b47840700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1875735413489920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841228.303391:0:19184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b47840700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1875735413489920:12345-0@lo:400:kworker.0 Request processed in 33us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841228.303397:0:19184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788841228.303406:0:19184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788841228.303411:0:19184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a46b0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1875735413490432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841228.303431:0:19184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a46b0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1875735413490432:12345-0@lo:400:kworker.0 Request processed in 20us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841228.303436:0:19184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788841228.303453:0:20345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788841228.303459:0:20345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b81c9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875735413490688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841228.303481:0:20345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b81c9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875735413490688:12345-0@lo:400:kworker.0 Request processed in 22us (1091us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841228.303486:0:20345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788841228.303497:0:20345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788841228.303502:0:20345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b47842680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875735413490560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841228.303521:0:20345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b47842680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875735413490560:12345-0@lo:400:kworker.0 Request processed in 19us (1036us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841228.303526:0:20345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788841228.303534:0:20345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788841228.303539:0:20345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b47841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875735413491072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841228.303558:0:20345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b47841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875735413491072:12345-0@lo:400:kworker.0 Request processed in 19us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841228.303569:0:20345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788841228.303579:0:20345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788841228.303584:0:20345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a46b0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875735413490944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841228.303606:0:20345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a46b0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875735413490944:12345-0@lo:400:kworker.0 Request processed in 22us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841228.303612:0:20345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788841228.303621:0:20345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788841228.303625:0:20345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7fa05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875735413490816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841228.303644:0:20345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7fa05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875735413490816:12345-0@lo:400:kworker.0 Request processed in 19us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841228.303649:0:20345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:2.0:1788841228.303693:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa04b7f84ed80 x1875735413490816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841228.303709:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7f84ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1875735413490816:0@lo:400:kworker.0 00000100:00100000:2.0:1788841228.303719:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47cbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875735413489920:0@lo:400:kworker.0 00000100:00100000:2.0:1788841228.303728:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47b45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875735413490432:0@lo:400:kworker.0 00000100:00100000:2.0:1788841228.303751:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7f84c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1875735413490944:0@lo:400:kworker.0 00000100:00100000:2.0:1788841228.304023:0:18209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413489792 00000100:00100000:2.0:1788841228.304029:0:18209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413489792 00000100:00100000:2.0:1788841228.304054:0:18209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413490304 00000100:00100000:2.0:1788841228.304057:0:18209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413490304 00000100:00100000:0.0:1788841228.304165:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788841228.304174:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7fa04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875735413489792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841228.304230:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7fa04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875735413489792:12345-0@lo:400:kworker.0 Request processed in 58us (1582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841228.304236:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788841228.304366:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413489664 00000100:00100000:3.0:1788841228.304372:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413489664 00000100:00100000:3.0:1788841228.304400:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788841228.304406:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47ee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab398079-8cf9-457a-bcc0-cfc99d2f260b+24:3650:x1875735413489664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841228.304439:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47ee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab398079-8cf9-457a-bcc0-cfc99d2f260b+24:3650:x1875735413489664:12345-0@lo:400:kworker.0 Request processed in 33us (2293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841228.304445:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:3.0:1788841228.304505:0:17202:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788841228.304511:0:17202:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788841228.304514:0:17202:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788841228.304518:0:17202:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788841228.304554:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7f9c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875735413490048:0@lo:400:kworker.0 00000100:00100000:3.0:1788841228.304567:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875735413490560:0@lo:400:kworker.0 00010000:00080000:3.0:1788841228.304580:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa04b6e05e300 x1875735413491072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841228.304591:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1875735413491072:0@lo:400:kworker.0 00000100:00100000:3.0:1788841228.304602:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7f8f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ab398079-8cf9-457a-bcc0-cfc99d2f260b:3650:1875735413489664:0@lo:400:kworker.0 00000100:00100000:3.0:1788841228.304614:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47b44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875735413490176:0@lo:400:kworker.0 00000100:00100000:3.0:1788841228.304641:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1875735413490688:0@lo:400:kworker.0 00000100:00100000:0.0:1788841228.304722:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788841228.304733:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7fa05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875735413490304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841228.304877:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7fa05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875735413490304:12345-0@lo:400:kworker.0 Request processed in 146us (2186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841228.304985:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413489536 00000100:00100000:1.0:1788841228.304990:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413489536 00000100:00100000:1.0:1788841228.305026:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788841228.305033:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b491d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875735413489536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788841228.305054:0:18719:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788841228.305098:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b491d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875735413489536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (3518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841228.305104:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1788841228.305138:0:17202:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788841228.305164:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7f8f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875735413489536:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788841228.305176:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788841228.305183:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47d41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875735413491200:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788841228.305436:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47c45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875735413489792:0@lo:400:kworker.0 00000100:00100000:3.0:1788841228.305447:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875735413490304:0@lo:400:kworker.0 00000100:00100000:1.0:1788841228.305909:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841228.307221:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413491200 00000100:00100000:3.0:1788841228.307232:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413491200 00000100:00100000:3.0:1788841228.307306:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788841228.307316:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47d40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875735413491200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788841228.307342:0:18719:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788841228.307405:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47d40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875735413491200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (1496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841228.307411:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788841228.311062:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47d41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875735413491200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788841228.316925:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00010000:1.0:1788841228.749298:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788841229.708759:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:0.0:1788841229.708807:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:0.0:1788841229.708914:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:0.0:1788841229.708956:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:1.0:1788841229.709080:0:18363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392438656 00000100:00100000:1.0:1788841229.709090:0:18363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392438656 00000100:00100000:1.0:1788841229.709174:0:18363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392438528 00000100:00100000:1.0:1788841229.709178:0:18363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392438528 00000100:00100000:1.0:1788841229.709194:0:18363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392438784 00000100:00100000:1.0:1788841229.709197:0:18363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392438784 00000100:00100000:1.0:1788841229.709214:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 4 00000100:00100000:1.0:1788841229.709224:0:18363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7fa07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1601f4c1-9799-4f1d-845e-9f3347550705+15:2400:x1875735392438656:12345-192.168.204.7@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788841229.709248:0:18363:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788841229.709278:0:18363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa04b67bb3e00/0x5757cd208ac37c45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53867 expref: 15 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841229.709296:0:18363:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788841229.709357:0:18363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7fa07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1601f4c1-9799-4f1d-845e-9f3347550705+14:2400:x1875735392438656:12345-192.168.204.7@tcp:103:ldlm_bl.0 Request processed in 134us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841229.709364:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 4 00000100:00100000:1.0:1788841229.709383:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 5 00000100:00100000:1.0:1788841229.709389:0:18363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7fa07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1601f4c1-9799-4f1d-845e-9f3347550705+13:2400:x1875735392438528:12345-192.168.204.7@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788841229.709398:0:18363:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788841229.709407:0:18363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa04b7f8c4c00/0x5757cd208ac37c3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53836 expref: 13 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841229.709418:0:18363:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788841229.709438:0:18363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7fa07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1601f4c1-9799-4f1d-845e-9f3347550705+12:2400:x1875735392438528:12345-192.168.204.7@tcp:103:ldlm_bl.0 Request processed in 48us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841229.709448:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 6 00000100:00100000:2.0:1788841229.709461:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7c02b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1601f4c1-9799-4f1d-845e-9f3347550705+12:2400:x1875735392438784:12345-192.168.204.7@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788841229.709481:0:17193:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788841229.709493:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa04a47cacc00/0x5757cd208ac37d02 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd5391d expref: 12 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841229.709506:0:17193:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788841229.709518:0:19184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392438400 00000100:00100000:3.0:1788841229.709525:0:19184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392438400 00000100:00100000:2.0:1788841229.709531:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7c02b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1601f4c1-9799-4f1d-845e-9f3347550705+11:2400:x1875735392438784:12345-192.168.204.7@tcp:103:ldlm_bl.0 Request processed in 73us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841229.709579:0:19184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 35 00000100:00100000:3.0:1788841229.709588:0:19184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7c02aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d9869f3a-61f0-4dde-ae0a-6fe2d2b9a51b+6:2399:x1875735392438400:12345-192.168.204.7@tcp:9:umount.0 00000020:00000080:3.0:1788841229.709620:0:19184:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac37c68 00000020:00010000:3.0:1788841229.709627:0:19184:0:(genops.c:1921:obd_stale_export_put()) Put export ffffa04b7f868000: total 0 00000100:00080000:3.0:1788841229.709632:0:19184:0:(import.c:65:import_set_state_nolock()) ffffa04b7f869800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788841229.709678:0:19184:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:3.0:1788841229.709814:0:19184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7c02aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d9869f3a-61f0-4dde-ae0a-6fe2d2b9a51b+4:2399:x1875735392438400:12345-192.168.204.7@tcp:9:umount.0 Request processed in 227us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841229.709821:0:19184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 35 00000020:00010000:3.0:1788841229.709867:0:17960:0:(genops.c:1907:obd_stale_export_get()) Get export ffffa04b7f868000: total 0 00010000:00010000:3.0:1788841229.709891:0:17960:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffffa04b7f868000, canceled 0 locks, left on hash table 1. 00002000:00010000:3.0:1788841229.709926:0:17960:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788841229.709936:0:17960:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1788841211 -> 1788841212 00002000:00010000:3.0:1788841229.709938:0:17960:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788841211 -> 1788841212 00002000:00010000:3.0:1788841229.709941:0:17960:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788841229.709961:0:17960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c032fc19/0x5757cd208ac37fd3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd539fd expref: 3 pid: 18715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841229.709983:0:17960:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffffa04b7f868000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788841229.709996:0:17960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841229.709999:0:17960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841229.710001:0:17960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788841229.710257:0:17202:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788841229.716651:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:3.0:1788841229.716697:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:3.0:1788841229.716712:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:3.0:1788841229.716737:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:3.0:1788841229.716771:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392439040 00000100:00100000:3.0:1788841229.716781:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392439040 00000100:00100000:3.0:1788841229.716854:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392439296 00000100:00100000:3.0:1788841229.716857:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392439296 00000100:00100000:3.0:1788841229.716874:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392438912 00000100:00100000:3.0:1788841229.716876:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392438912 00000100:00100000:3.0:1788841229.716888:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392439168 00000100:00100000:3.0:1788841229.716890:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392439168 00000100:00100000:3.0:1788841229.716906:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 92 00000100:00100000:3.0:1788841229.716915:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6e05e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d9869f3a-61f0-4dde-ae0a-6fe2d2b9a51b+5:2401:x1875735392439040:12345-192.168.204.7@tcp:400:kworker.0 00000100:00100000:3.0:1788841229.716989:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6e05e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d9869f3a-61f0-4dde-ae0a-6fe2d2b9a51b+5:2401:x1875735392439040:12345-192.168.204.7@tcp:400:kworker.0 Request processed in 74us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841229.716997:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 92 00000100:00100000:3.0:1788841229.717016:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 93 00000100:00100000:3.0:1788841229.717022:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6e05d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:05b5e23c-fb41-484b-af6b-585a3a9027d2+5:2401:x1875735392439296:12345-192.168.204.7@tcp:400:kworker.0 00000100:00100000:3.0:1788841229.717064:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6e05d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:05b5e23c-fb41-484b-af6b-585a3a9027d2+5:2401:x1875735392439296:12345-192.168.204.7@tcp:400:kworker.0 Request processed in 42us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841229.717071:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 93 00000100:00100000:3.0:1788841229.717084:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 94 00000100:00100000:3.0:1788841229.717091:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6e05c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d9869f3a-61f0-4dde-ae0a-6fe2d2b9a51b+12:2401:x1875735392438912:12345-192.168.204.7@tcp:400:kworker.0 00000100:00100000:3.0:1788841229.717115:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6e05c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d9869f3a-61f0-4dde-ae0a-6fe2d2b9a51b+12:2401:x1875735392438912:12345-192.168.204.7@tcp:400:kworker.0 Request processed in 26us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841229.717122:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 94 00000100:00100000:3.0:1788841229.717132:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 95 00000100:00100000:3.0:1788841229.717138:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6e05d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:05b5e23c-fb41-484b-af6b-585a3a9027d2+6:2401:x1875735392439168:12345-192.168.204.7@tcp:400:kworker.0 00000100:00100000:3.0:1788841229.717176:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6e05d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:05b5e23c-fb41-484b-af6b-585a3a9027d2+6:2401:x1875735392439168:12345-192.168.204.7@tcp:400:kworker.0 Request processed in 23us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841229.717183:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 95 00000100:00080000:0.0:1788841229.720216:0:17202:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788841229.720238:0:17202:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788841229.724635:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 5 00000100:00100000:2.0:1788841229.724989:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 6 00000100:00100000:3.0:1788841229.738750:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:0.0:1788841229.738921:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392440192 00000100:00100000:0.0:1788841229.738932:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392440192 00000100:00100000:0.0:1788841229.738999:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 76 00000100:00100000:0.0:1788841229.739009:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6e05ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d9869f3a-61f0-4dde-ae0a-6fe2d2b9a51b+12:2399:x1875735392440192:12345-192.168.204.7@tcp:39:umount.0 00000020:00000080:0.0:1788841229.739042:0:17207:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac37c53 00000020:00010000:0.0:1788841229.739061:0:17207:0:(genops.c:1921:obd_stale_export_put()) Put export ffffa04a47c7a000: total 0 00000100:00080000:0.0:1788841229.739078:0:17207:0:(import.c:65:import_set_state_nolock()) ffffa04b7cbb1000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788841229.739109:0:17207:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934636 00000100:00100000:0.0:1788841229.739342:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6e05ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d9869f3a-61f0-4dde-ae0a-6fe2d2b9a51b+11:2399:x1875735392440192:12345-192.168.204.7@tcp:39:umount.0 Request processed in 333us (604us total) trans 8589934637 rc 0/0 00000100:00100000:0.0:1788841229.739351:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 76 00000020:00010000:1.0:1788841229.740380:0:17195:0:(genops.c:1907:obd_stale_export_get()) Get export ffffa04a47c7a000: total 0 00010000:00010000:1.0:1788841229.740391:0:17195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841229.740452:0:17195:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffffa04a47c7a000, canceled 0 locks, left on hash table 7. 00010000:00010000:1.0:1788841229.740499:0:17195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa04b44fd8a00) 00010000:00010000:1.0:1788841229.740503:0:17195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788841229.740521:0:17195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04a47e42a00/0x5757cd208ac37f24 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd539c5 expref: 10 pid: 20345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841229.740545:0:17195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa04b44fd8a00) 00010000:00010000:1.0:1788841229.740547:0:17195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788841229.740551:0:17195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04a474ae800/0x5757cd208ac37fe8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53a04 expref: 9 pid: 20345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841229.740604:0:17195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa04a47b30200) 00010000:00010000:1.0:1788841229.740608:0:17195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788841229.740612:0:17195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2400/0x5757cd208ac37d1e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53924 expref: 8 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841229.740629:0:17195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa04a47b30700) 00010000:00010000:1.0:1788841229.740632:0:17195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788841229.740635:0:17195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04a47e42000/0x5757cd208ac37dfe lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53963 expref: 7 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841229.740663:0:17195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa04b558f7800) 00010000:00010000:1.0:1788841229.740666:0:17195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788841229.740671:0:17195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7a722600/0x5757cd208ac37f7f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd539da expref: 6 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841229.740687:0:17195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa04a4681c700) 00010000:00010000:1.0:1788841229.740689:0:17195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788841229.740692:0:17195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04a47cada00/0x5757cd208ac37d3a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd5392b expref: 5 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841229.740710:0:17195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa04b558f7100) 00010000:00010000:1.0:1788841229.740712:0:17195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788841229.740716:0:17195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4e00/0x5757cd208ac37d79 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53939 expref: 4 pid: 20345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841229.740726:0:17195:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffffa04a47c7a000, canceled 7 locks, left on hash table 0. 00010000:00010000:1.0:1788841229.740740:0:17195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841229.740747:0:17195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841229.740750:0:17195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788841229.758361:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:2.0:1788841229.759447:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392440320 00000100:00100000:2.0:1788841229.759461:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392440320 00000100:00100000:2.0:1788841229.759550:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 77 00000100:00100000:2.0:1788841229.759560:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7c028380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d9869f3a-61f0-4dde-ae0a-6fe2d2b9a51b+5:2399:x1875735392440320:12345-192.168.204.7@tcp:39:umount.0 00000020:00000080:2.0:1788841229.759596:0:17208:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac37c5a 00000100:00080000:2.0:1788841229.759618:0:17208:0:(import.c:65:import_set_state_nolock()) ffffa04b7cbb0800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788841229.759654:0:17208:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1788841229.759934:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7c028380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d9869f3a-61f0-4dde-ae0a-6fe2d2b9a51b+3:2399:x1875735392440320:12345-192.168.204.7@tcp:39:umount.0 Request processed in 375us (1585us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788841229.759943:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 77 00010000:00010000:1.0:1788841229.760054:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841229.773003:0:17960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841230.349183:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788841230.349208:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47d41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875735413491328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788841230.349300:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841230.349485:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413491328 00000100:00100000:1.0:1788841230.349495:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413491328 00000100:00100000:1.0:1788841230.349562:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788841230.349574:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6e05d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875735413491328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788841230.349615:0:18719:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788841230.349664:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6e05d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875735413491328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841230.349671:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788841230.349714:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47d41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875735413491328:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788841230.349780:0:17202:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788841230.800352:0:17195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841231.373777:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788841231.373804:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875735413491456:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788841231.373900:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841231.373957:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413491456 00000100:00100000:3.0:1788841231.373966:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413491456 00000100:00100000:3.0:1788841231.374016:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788841231.374026:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6e05f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875735413491456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788841231.374075:0:17211:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1788841231.374124:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6e05f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875735413491456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841231.374143:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788841231.374204:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875735413491456:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788841231.374743:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788841231.374755:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c02ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875735413491584:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788841231.374790:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841231.375126:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413491584 00000100:00100000:0.0:1788841231.375142:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413491584 00000100:00100000:0.0:1788841231.375183:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788841231.375191:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6e05fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875735413491584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788841231.375226:0:17212:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788841231.375720:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6e05fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875735413491584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 528us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841231.375738:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788841231.375827:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c02ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875735413491584:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788841231.376140:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b491d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875735413491712:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788841231.376176:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841231.376388:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413491712 00000100:00100000:3.0:1788841231.376394:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413491712 00000100:00100000:3.0:1788841231.376447:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788841231.376457:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47d41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875735413491712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788841231.376479:0:18719:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00080000:0.0:1788841231.377029:0:17202:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788841231.377607:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47d41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875735413491712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1148us (1426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841231.377616:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788841231.377869:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b491d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875735413491712:0@lo:13:osp-pre-0-1.0 00000040:00080000:1.0:1788841231.565078:0:17242:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788841231.565092:0:17242:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788841231.565119:0:17242:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788841231.565140:0:17242:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788841231.728727:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:3.0:1788841231.729111:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:3.0:1788841231.735392:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:0.0:1788841231.735787:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392440448 00000100:00100000:0.0:1788841231.735799:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392440448 00000100:00100000:0.0:1788841231.735890:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392440576 00000100:00100000:0.0:1788841231.735894:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392440576 00000100:00100000:0.0:1788841231.735921:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 7 00000100:00100000:0.0:1788841231.735931:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6e05c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1601f4c1-9799-4f1d-845e-9f3347550705+11:2403:x1875735392440448:12345-192.168.204.7@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788841231.735947:0:17192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788841231.735967:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa04b67bb3800/0x5757cd208ac37c7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd538a6 expref: 11 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841231.735985:0:17192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788841231.736043:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6e05c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1601f4c1-9799-4f1d-845e-9f3347550705+10:2403:x1875735392440448:12345-192.168.204.7@tcp:103:ldlm_bl.0 Request processed in 113us (7328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841231.736051:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 7 00000100:00100000:0.0:1788841231.736071:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 8 00000100:00100000:0.0:1788841231.736078:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6e05e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1601f4c1-9799-4f1d-845e-9f3347550705+9:2403:x1875735392440576:12345-192.168.204.7@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788841231.736085:0:17192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788841231.736094:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa04a47cace00/0x5757cd208ac37c84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd538d7 expref: 9 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841231.736105:0:17192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788841231.736134:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6e05e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1601f4c1-9799-4f1d-845e-9f3347550705+8:2403:x1875735392440576:12345-192.168.204.7@tcp:103:ldlm_bl.0 Request processed in 44us (7011us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841231.736141:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 8 00000100:00100000:2.0:1788841231.746023:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392440704 00000100:00100000:2.0:1788841231.746040:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392440704 00000100:00100000:2.0:1788841231.746136:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 9 00000100:00100000:2.0:1788841231.746147:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6e05ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1601f4c1-9799-4f1d-845e-9f3347550705+8:2401:x1875735392440704:12345-192.168.204.7@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788841231.746167:0:17192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788841231.746192:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa04a47cac400/0x5757cd208ac37cfb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53916 expref: 8 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841231.746211:0:17192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788841231.747864:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6e05ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1601f4c1-9799-4f1d-845e-9f3347550705+7:2401:x1875735392440704:12345-192.168.204.7@tcp:103:ldlm_bl.0 Request processed in 1708us (12474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841231.747878:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 9 00000100:00100000:2.0:1788841231.762911:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:3.0:1788841231.763775:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392440960 00000100:00100000:3.0:1788841231.763790:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392440960 00000100:00100000:3.0:1788841231.763924:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 78 00000100:00100000:3.0:1788841231.763937:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b491d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:05b5e23c-fb41-484b-af6b-585a3a9027d2+6:2399:x1875735392440960:12345-192.168.204.7@tcp:39:umount.0 00000020:00000080:3.0:1788841231.763982:0:17207:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac37c92 00000020:00010000:3.0:1788841231.763990:0:17207:0:(genops.c:1921:obd_stale_export_put()) Put export ffffa04b47814800: total 0 00000100:00080000:3.0:1788841231.763995:0:17207:0:(import.c:65:import_set_state_nolock()) ffffa04b47810800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788841231.764045:0:17207:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934637 00000100:00100000:3.0:1788841231.764242:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b491d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:05b5e23c-fb41-484b-af6b-585a3a9027d2+5:2399:x1875735392440960:12345-192.168.204.7@tcp:39:umount.0 Request processed in 307us (1343us total) trans 8589934638 rc 0/0 00000100:00100000:3.0:1788841231.764251:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 78 00000020:00010000:1.0:1788841231.764474:0:17194:0:(genops.c:1907:obd_stale_export_get()) Get export ffffa04b47814800: total 0 00010000:00010000:1.0:1788841231.764528:0:17194:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffffa04b47814800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788841231.764568:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa04b558f7100) 00010000:00010000:1.0:1788841231.764573:0:17194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788841231.764582:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3000/0x5757cd208ac37d87 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53940 expref: 4 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841231.764620:0:17194:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffffa04b47814800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788841231.764635:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841231.764637:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841231.764638:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788841231.765204:0:17202:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788841231.776904:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:0.0:1788841231.777003:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392441088 00000100:00100000:0.0:1788841231.777015:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392441088 00000100:00100000:0.0:1788841231.777109:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 79 00000100:00100000:0.0:1788841231.777132:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b491d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:05b5e23c-fb41-484b-af6b-585a3a9027d2+5:2399:x1875735392441088:12345-192.168.204.7@tcp:39:umount.0 00000020:00000080:0.0:1788841231.777182:0:17208:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac37c99 00000100:00080000:0.0:1788841231.777192:0:17208:0:(import.c:65:import_set_state_nolock()) ffffa04b47812000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788841231.777225:0:17208:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:0.0:1788841231.777424:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b491d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:05b5e23c-fb41-484b-af6b-585a3a9027d2+3:2399:x1875735392441088:12345-192.168.204.7@tcp:39:umount.0 Request processed in 305us (543us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788841231.777433:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 79 00000100:00080000:2.0:1788841231.777793:0:17202:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788841231.777911:0:17960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841231.821113:0:17195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841231.825728:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:0.0:1788841231.825899:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392441344 00000100:00100000:0.0:1788841231.825911:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392441344 00000100:00100000:0.0:1788841231.825981:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 173 00000100:00100000:0.0:1788841231.825992:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47ee4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1601f4c1-9799-4f1d-845e-9f3347550705+7:2399:x1875735392441344:12345-192.168.204.7@tcp:251:umount.0 00000020:00000080:0.0:1788841231.826040:0:17201:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac37c30 00000020:00010000:0.0:1788841231.826049:0:17201:0:(genops.c:1921:obd_stale_export_put()) Put export ffffa04a41b19800: total 0 00000100:00080000:0.0:1788841231.826055:0:17201:0:(import.c:65:import_set_state_nolock()) ffffa04a41b1d800 : changing import state from FULL to CLOSED 00000020:00010000:1.0:1788841231.826301:0:17194:0:(genops.c:1907:obd_stale_export_get()) Get export ffffa04a41b19800: total 0 00010000:00010000:1.0:1788841231.826356:0:17194:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffffa04a41b19800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788841231.826404:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa04a47cad000/0x5757cd208ac37c37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd5382f expref: 3 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841231.826422:0:17194:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffffa04a41b19800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788841231.826434:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841231.826436:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841231.826437:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788841231.827508:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47ee4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1601f4c1-9799-4f1d-845e-9f3347550705+1:2399:x1875735392441344:12345-192.168.204.7@tcp:251:umount.0 Request processed in 1510us (1785us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841231.827519:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 173 00000020:00000080:0.0:1788841231.827537:0:17201:0:(genops.c:885:class_export_put()) final put ffffa04a41b19800/1601f4c1-9799-4f1d-845e-9f3347550705 00000020:00000080:1.0:1788841231.827802:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa04a41b19800/1601f4c1-9799-4f1d-845e-9f3347550705 for MGS 00000020:00000080:1.0:1788841231.827871:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa04a41b1d800 for MGS 00010000:00010000:3.0:1788841232.851077:0:17960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841233.425282:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c02b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ab398079-8cf9-457a-bcc0-cfc99d2f260b:3651:1875735413491840:0@lo:400:kworker.0 00000100:00100000:0.0:1788841233.425347:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c029c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875735413491968:0@lo:400:kworker.0 00000100:00100000:3.0:1788841233.425382:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841233.425382:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841233.425550:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c028700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875735413492352:0@lo:400:kworker.0 00000100:00100000:1.0:1788841233.425552:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c029500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875735413492224:0@lo:400:kworker.0 00000100:00100000:3.0:1788841233.425577:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841233.425577:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841233.425595:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c02bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875735413492864:0@lo:400:kworker.0 00000100:00100000:1.0:1788841233.425595:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c029880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875735413492736:0@lo:400:kworker.0 00000100:00100000:3.0:1788841233.425615:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841233.425615:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841233.425630:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c028a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875735413493376:0@lo:400:kworker.0 00000100:00100000:1.0:1788841233.425630:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c02a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1875735413493248:0@lo:400:kworker.0 00000100:00100000:1.0:1788841233.425648:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841233.425659:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413491840 00000100:00100000:3.0:1788841233.425666:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413491840 00000100:00100000:1.0:1788841233.425668:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788841233.425673:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c02a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875735413492096:0@lo:400:kworker.0 00000100:00100000:1.0:1788841233.425693:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841233.425709:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c028e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875735413492608:0@lo:400:kworker.0 00000100:00100000:3.0:1788841233.425723:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788841233.425732:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47ee5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab398079-8cf9-457a-bcc0-cfc99d2f260b+24:3651:x1875735413491840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841233.425767:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841233.425775:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47ee5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab398079-8cf9-457a-bcc0-cfc99d2f260b+24:3651:x1875735413491840:12345-0@lo:400:kworker.0 Request processed in 43us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841233.425782:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788841233.425783:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c028000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1875735413493120:0@lo:400:kworker.0 00000100:00100000:1.0:1788841233.425801:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841233.425823:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875735413493632:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788841233.425849:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413492352 00000100:00100000:3.0:1788841233.425853:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413492352 00000100:00100000:1.0:1788841233.425869:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841233.425874:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413492864 00000100:00100000:3.0:1788841233.425876:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413492864 00000100:00100000:3.0:1788841233.425887:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413493248 00000100:00100000:3.0:1788841233.425889:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413493248 00000100:00100000:1.0:1788841233.425895:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413493120 00000100:00100000:1.0:1788841233.425898:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413493120 00000100:00100000:3.0:1788841233.425922:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788841233.426199:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788841233.426209:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6e05f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875735413492864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841233.426246:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6e05f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875735413492864:12345-0@lo:400:kworker.0 Request processed in 40us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841233.426253:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788841233.426267:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788841233.426272:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47d43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875735413493248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841233.426300:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47d43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875735413493248:12345-0@lo:400:kworker.0 Request processed in 27us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841233.426305:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788841233.426317:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788841233.426322:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47d42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875735413493120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841233.426347:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47d42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875735413493120:12345-0@lo:400:kworker.0 Request processed in 25us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841233.426352:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788841233.426374:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413493632 00000100:00100000:1.0:1788841233.426378:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413493632 00000100:00100000:1.0:1788841233.426407:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788841233.426413:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47d40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875735413493632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788841233.426443:0:18718:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788841233.426479:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47d40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875735413493632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841233.426485:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788841233.426527:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875735413493632:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788841233.426563:0:18209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413491968 00000100:00100000:1.0:1788841233.426566:0:18209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413491968 00000100:00100000:1.0:1788841233.426587:0:18209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788841233.426592:0:18209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7c029f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875735413491968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841233.426624:0:18209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7c029f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875735413491968:12345-0@lo:400:kworker.0 Request processed in 32us (1241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841233.426629:0:18209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788841233.426690:0:19184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413492224 00000100:00100000:1.0:1788841233.426694:0:19184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413492224 00000100:00100000:1.0:1788841233.426714:0:19184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413492736 00000100:00100000:1.0:1788841233.426716:0:19184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413492736 00000100:00100000:1.0:1788841233.426725:0:19184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413492096 00000100:00100000:1.0:1788841233.426727:0:19184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413492096 00000100:00100000:1.0:1788841233.426815:0:19184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413492608 00000100:00100000:1.0:1788841233.426818:0:19184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413492608 00000100:00100000:1.0:1788841233.426829:0:19184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788841233.426859:0:19184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47d40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875735413492224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841233.426889:0:19184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47d40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875735413492224:12345-0@lo:400:kworker.0 Request processed in 31us (1311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841233.426894:0:19184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788841233.426904:0:19184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788841233.426911:0:19184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47d41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875735413492736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841233.426945:0:19184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47d41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875735413492736:12345-0@lo:400:kworker.0 Request processed in 34us (1330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841233.426952:0:19184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788841233.426961:0:19184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788841233.426966:0:19184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47d43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875735413492096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841233.426990:0:19184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47d43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875735413492096:12345-0@lo:400:kworker.0 Request processed in 23us (1295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841233.426995:0:19184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788841233.427004:0:19184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788841233.427075:0:19184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47d40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875735413492608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841233.427115:0:19184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47d40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875735413492608:12345-0@lo:400:kworker.0 Request processed in 42us (1356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841233.427121:0:19184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788841233.427153:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841233.427185:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c02b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ab398079-8cf9-457a-bcc0-cfc99d2f260b:3651:1875735413491840:0@lo:400:kworker.0 00000100:00100000:1.0:1788841233.427210:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c02bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875735413492864:0@lo:400:kworker.0 00000100:00100000:1.0:1788841233.427218:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788841233.427225:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47d41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875735413493504:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788841233.427273:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841233.427276:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6e05df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875735413492352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841233.427303:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413493504 00000100:00100000:1.0:1788841233.427307:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413493504 00000100:00100000:3.0:1788841233.427319:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6e05df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875735413492352:12345-0@lo:400:kworker.0 Request processed in 1391us (1741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841233.427325:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788841233.427327:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788841233.427331:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6d9e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875735413493504:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788841233.427336:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413493376 00000100:00100000:3.0:1788841233.427339:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413493376 00002000:00000024:1.0:1788841233.427342:0:18718:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788841233.427368:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6d9e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875735413493504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 36us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841233.427381:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788841233.427401:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788841233.427408:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47d40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875735413493376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841233.427439:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47d40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875735413493376:12345-0@lo:400:kworker.0 Request processed in 32us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841233.427445:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:1.0:1788841233.427478:0:17202:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788841233.427482:0:17202:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788841233.427485:0:17202:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788841233.427487:0:17202:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788841233.427515:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c02a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875735413492096:0@lo:400:kworker.0 00000100:00100000:3.0:1788841233.427520:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47d41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875735413493504:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788841233.427525:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c028e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875735413492608:0@lo:400:kworker.0 00000100:00100000:3.0:1788841233.427531:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c028700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875735413492352:0@lo:400:kworker.0 00010000:00080000:1.0:1788841233.427536:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa04b7c028000 x1875735413493120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1788841233.427539:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa04b7c028a80 x1875735413493376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841233.427548:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c028a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875735413493376:0@lo:400:kworker.0 00000100:00100000:1.0:1788841233.427548:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c028000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1875735413493120:0@lo:400:kworker.0 00000100:00100000:1.0:1788841233.427556:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c029500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875735413492224:0@lo:400:kworker.0 00000100:00100000:1.0:1788841233.427565:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c029880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875735413492736:0@lo:400:kworker.0 00000100:00100000:1.0:1788841233.427573:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c02a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1875735413493248:0@lo:400:kworker.0 00000100:00100000:0.0:1788841233.427870:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c029c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875735413491968:0@lo:400:kworker.0 00000100:00100000:0.0:1788841233.427879:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c029180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875735413492480:0@lo:400:kworker.0 00000100:00100000:0.0:1788841233.427905:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841233.427929:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c02b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1875735413492992:0@lo:400:kworker.0 00000100:00100000:0.0:1788841233.427951:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841233.427982:0:20345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413492992 00000100:00100000:0.0:1788841233.427986:0:20345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413492992 00000100:00100000:0.0:1788841233.428169:0:20345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788841233.428176:0:20345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7c029880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875735413492992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841233.428214:0:20345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7c029880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875735413492992:12345-0@lo:400:kworker.0 Request processed in 38us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841233.428219:0:20345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788841233.428247:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c02b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1875735413492992:0@lo:400:kworker.0 00000100:00080000:0.0:1788841233.428261:0:17202:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788841233.428769:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413492480 00000100:00100000:3.0:1788841233.428775:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413492480 00000100:00100000:3.0:1788841233.428817:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788841233.428825:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7c02a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875735413492480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841233.428894:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7c02a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875735413492480:12345-0@lo:400:kworker.0 Request processed in 70us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841233.428905:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788841233.428935:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c029180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875735413492480:0@lo:400:kworker.0 00010000:00010000:1.0:1788841233.870500:0:17195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788841233.899329:0:20779:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788841233.914996:0:20779:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788841233.915056:0:20779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b81b5c800/0x5757cd208ac377f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac377fa expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841233.915072:0:20779:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b81b5c800/0x5757cd208ac377f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5757cd208ac377fa expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841233.915105:0:20779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b81b5c800/0x5757cd208ac377f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x5757cd208ac377fa expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841233.915113:0:20779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.107@tcp lock: ffffa04b81b5c800/0x5757cd208ac377f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x5757cd208ac377fa expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841233.915130:0:20779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788841233.915135:0:20779:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788841233.915165:0:20779:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788841233.915170:0:20779:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788841233.915176:0:20779:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788841233.915202:0:20779:0:(import.c:65:import_set_state_nolock()) ffffa04b6dc6f800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1788841233.915277:0:17194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788841233.915285:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.107@tcp lock: ffffa04b81b5c800/0x5757cd208ac377f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x5757cd208ac377fa expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841233.915293:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b81b5c800 already unused, calling callback (ffffffffc11a4c20) 10000000:00010000:1.0:1788841233.915302:0:17194:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.107@tcp lock: ffffa04b81b5c800/0x5757cd208ac377f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x5757cd208ac377fa expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841233.915311:0:17194:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.107@tcp lock: ffffa04b81b5c800/0x5757cd208ac377f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x5757cd208ac377fa expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788841233.915319:0:17194:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.107@tcp lock: ffffa04b81b5c800/0x5757cd208ac377f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x5757cd208ac377fa expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788841233.915325:0:17194:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788841233.915328:0:17194:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788841233.915330:0:17194:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788841233.915358:0:17194:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.107@tcp lock: ffffa04b81b5c800/0x5757cd208ac377f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5757cd208ac377fa expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841233.915364:0:17194:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788841233.915391:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.107@tcp lock: ffffa04b81b5c800/0x5757cd208ac377f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5757cd208ac377fa expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841233.915398:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.107@tcp lock: ffffa04b81b5c800/0x5757cd208ac377f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5757cd208ac377fa expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841233.915410:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841233.915411:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841233.915413:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841233.915444:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788841233.915462:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6d9e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ab398079-8cf9-457a-bcc0-cfc99d2f260b:3649:1875735413493888:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788841233.915527:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841233.915607:0:18363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413493888 00000100:00100000:1.0:1788841233.915615:0:18363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413493888 00000100:00100000:1.0:1788841233.915666:0:18363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788841233.915674:0:18363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47c0e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab398079-8cf9-457a-bcc0-cfc99d2f260b+24:3649:x1875735413493888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788841233.915687:0:18363:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788841233.915704:0:18363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa04a47cac800/0x5757cd208ac377fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5757cd208ac377f3 expref: 24 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841233.915724:0:18363:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788841233.915766:0:18363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47c0e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab398079-8cf9-457a-bcc0-cfc99d2f260b+23:3649:x1875735413493888:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841233.915785:0:18363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788841233.915865:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6d9e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ab398079-8cf9-457a-bcc0-cfc99d2f260b:3649:1875735413493888:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788841233.916088:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875735413493760:0@lo:39:umount.0 00000100:00100000:2.0:1788841233.916120:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841233.916192:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413493760 00000100:00100000:3.0:1788841233.916197:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413493760 00000100:00100000:3.0:1788841233.916234:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788841233.916241:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b491d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875735413493760:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788841233.916261:0:17207:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac37824 00000100:00080000:3.0:1788841233.916268:0:17207:0:(import.c:65:import_set_state_nolock()) ffffa04b7cea5000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788841233.916330:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b491d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3648:x1875735413493760:12345-0@lo:39:umount.0 Request processed in 88us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841233.916336:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000020:00000080:3.0:1788841233.916343:0:17207:0:(genops.c:885:class_export_put()) final put ffffa04a47e7a000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1788841233.916388:0:17960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788841233.916424:0:11140:0:(genops.c:844:class_export_destroy()) destroying export ffffa04a47e7a000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788841233.916475:0:11140:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa04b7cea5000 for lustre-MDT0000 00000100:00080000:2.0:1788841233.916501:0:3648:0:(import.c:65:import_set_state_nolock()) ffffa04b6dc6f800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788841233.916518:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875735413493760:0@lo:39:umount.0 00000100:00080000:3.0:1788841233.916568:0:20779:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788841233.916572:0:20779:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788841233.916584:0:20779:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788841233.917465:0:20779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b81b5da00/0x5757cd208ac37744 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac3774b expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841233.917480:0:20779:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b81b5da00/0x5757cd208ac37744 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5757cd208ac3774b expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841233.917486:0:20779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b81b5da00/0x5757cd208ac37744 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x5757cd208ac3774b expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841233.917493:0:20779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.107@tcp lock: ffffa04b81b5da00/0x5757cd208ac37744 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x5757cd208ac3774b expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841233.917521:0:20779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788841233.917527:0:20779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c4200/0x5757cd208ac37b50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac37b57 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841233.917535:0:20779:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c4200/0x5757cd208ac37b50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5757cd208ac37b57 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841233.917541:0:20779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c4200/0x5757cd208ac37b50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5757cd208ac37b57 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841233.917548:0:20779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c4200/0x5757cd208ac37b50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5757cd208ac37b57 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841233.917558:0:20779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788841233.917564:0:20779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04a47cac600/0x5757cd208ac37ced lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac37cf4 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841233.917570:0:20779:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04a47cac600/0x5757cd208ac37ced lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5757cd208ac37cf4 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841233.917583:0:20779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04a47cac600/0x5757cd208ac37ced lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5757cd208ac37cf4 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841233.917589:0:20779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.107@tcp lock: ffffa04a47cac600/0x5757cd208ac37ced lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5757cd208ac37cf4 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841233.917600:0:20779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788841233.917606:0:20779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b81b5c600/0x5757cd208ac37736 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac3773d expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841233.917614:0:20779:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b81b5c600/0x5757cd208ac37736 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5757cd208ac3773d expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841233.917619:0:20779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b81b5c600/0x5757cd208ac37736 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5757cd208ac3773d expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841233.917625:0:20779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.107@tcp lock: ffffa04b81b5c600/0x5757cd208ac37736 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5757cd208ac3773d expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841233.917632:0:20779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1788841233.917635:0:20779:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1788841233.917661:0:20779:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1788841233.917665:0:20779:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1788841233.917669:0:20779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788841233.917674:0:20779:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:3.0:1788841233.917679:0:20779:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffffa04b7f86d000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788841233.917685:0:20779:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffffa04b7f42f000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788841233.917689:0:20779:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffffa04a47d93800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788841233.917701:0:20779:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffffa04a47d04800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788841233.917708:0:20779:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffffa04b47814800 05b5e23c-fb41-484b-af6b-585a3a9027d2 192.168.204.7@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:3.0:1788841233.917712:0:20779:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffffa04a47c7a000 d9869f3a-61f0-4dde-ae0a-6fe2d2b9a51b 192.168.204.7@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934636 stale:0 00000020:00080000:3.0:1788841233.917717:0:20779:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffffa04a47c819b8) has exports, disconnecting them 00000020:00080000:3.0:1788841233.917722:0:20779:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffffa04b7f86d000), last request at 1788841233 00000020:00000080:3.0:1788841233.917728:0:20779:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac37b1f 00000100:00080000:3.0:1788841233.917747:0:20779:0:(import.c:65:import_set_state_nolock()) ffffa04b7f86c000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788841233.917794:0:20779:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa04b7f86d000): rc 0 00000020:00000080:3.0:1788841233.917797:0:20779:0:(genops.c:885:class_export_put()) final put ffffa04b7f86d000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1788841233.917805:0:20779:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffffa04b7f42f000), last request at 1788841233 00000020:00000080:3.0:1788841233.917808:0:20779:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac379c1 00000100:00080000:3.0:1788841233.917812:0:20779:0:(import.c:65:import_set_state_nolock()) ffffa04b7f429000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788841233.917818:0:20779:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa04b7f42f000): rc 0 00000020:00000080:3.0:1788841233.917820:0:20779:0:(genops.c:885:class_export_put()) final put ffffa04b7f42f000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1788841233.917824:0:20779:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffffa04a47d93800), last request at 1788841154 00000020:00000080:3.0:1788841233.917827:0:20779:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac37912 00000100:00080000:3.0:1788841233.917830:0:20779:0:(import.c:65:import_set_state_nolock()) ffffa04a47d96000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788841233.917854:0:20779:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa04a47d93800): rc 0 00000020:00000080:3.0:1788841233.917856:0:20779:0:(genops.c:885:class_export_put()) final put ffffa04a47d93800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1788841233.917860:0:20779:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffffa04a47d04800), last request at 1788841154 00000020:00000080:3.0:1788841233.917863:0:20779:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac378a9 00000100:00080000:3.0:1788841233.917866:0:20779:0:(import.c:65:import_set_state_nolock()) ffffa04a47d07800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788841233.917872:0:20779:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934638 00000020:00080000:3.0:1788841233.917936:0:20779:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa04a47d04800): rc 0 00000004:00000080:3.0:1788841233.917942:0:20779:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbd76c1557ae0 00000100:00080000:3.0:1788841233.917960:0:20779:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788841233.917969:0:20779:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788841233.918722:0:20779:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788841233.918748:0:20779:0:(import.c:65:import_set_state_nolock()) ffffa04b48483800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000020:00000080:0.0:1788841233.919011:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b7f86d000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788841233.919059:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b7f42f000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788841233.919101:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa04a47d93800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788841233.919120:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa04b7f86c000 for lustre-MDT0000 00000020:00000080:0.0:1788841233.919125:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa04b7f429000 for lustre-MDT0000 00000020:00000080:0.0:1788841233.919128:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa04a47d96000 for lustre-MDT0000 00010000:00010000:0.0:1788841233.919139:0:17960:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788841233.919146:0:17960:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.107@tcp lock: ffffa04b81b5da00/0x5757cd208ac37744 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x5757cd208ac3774b expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841233.919158:0:17960:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b81b5da00 already unused, calling callback (ffffffffc11a4c20) 10000000:00010000:0.0:1788841233.919163:0:17960:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.107@tcp lock: ffffa04b81b5da00/0x5757cd208ac37744 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x5757cd208ac3774b expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841233.919173:0:17960:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.107@tcp lock: ffffa04b81b5da00/0x5757cd208ac37744 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x5757cd208ac3774b expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788841233.919196:0:17960:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.107@tcp lock: ffffa04b81b5da00/0x5757cd208ac37744 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x5757cd208ac3774b expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788841233.919203:0:17960:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788841233.919205:0:17960:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:0.0:1788841233.919208:0:17960:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:0.0:1788841233.919238:0:17960:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.107@tcp lock: ffffa04b81b5da00/0x5757cd208ac37744 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5757cd208ac3774b expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841233.919244:0:17960:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788841233.919269:0:17960:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.107@tcp lock: ffffa04b81b5da00/0x5757cd208ac37744 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5757cd208ac3774b expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841233.919276:0:17960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.107@tcp lock: ffffa04b81b5da00/0x5757cd208ac37744 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5757cd208ac3774b expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841233.919288:0:17960:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788841233.919291:0:17960:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c4200/0x5757cd208ac37b50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5757cd208ac37b57 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841233.919296:0:17960:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b7f8c4200 already unused, calling callback (ffffffffc11a4c20) 10000000:00010000:0.0:1788841233.919299:0:17960:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c4200/0x5757cd208ac37b50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5757cd208ac37b57 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841233.919305:0:17960:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c4200/0x5757cd208ac37b50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5757cd208ac37b57 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788841233.919311:0:17960:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c4200/0x5757cd208ac37b50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5757cd208ac37b57 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788841233.919327:0:17960:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788841233.919329:0:17960:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788841233.919331:0:17960:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788841233.919346:0:17960:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c4200/0x5757cd208ac37b50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5757cd208ac37b57 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841233.919352:0:17960:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788841233.919357:0:17960:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c4200/0x5757cd208ac37b50 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5757cd208ac37b57 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841233.919363:0:17960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c4200/0x5757cd208ac37b50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5757cd208ac37b57 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841233.919372:0:17960:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788841233.919376:0:17960:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.107@tcp lock: ffffa04a47cac600/0x5757cd208ac37ced lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5757cd208ac37cf4 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841233.919381:0:17960:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a47cac600 already unused, calling callback (ffffffffc11a4c20) 10000000:00010000:0.0:1788841233.919384:0:17960:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.107@tcp lock: ffffa04a47cac600/0x5757cd208ac37ced lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5757cd208ac37cf4 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841233.919391:0:17960:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.107@tcp lock: ffffa04a47cac600/0x5757cd208ac37ced lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x5757cd208ac37cf4 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788841233.919397:0:17960:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.107@tcp lock: ffffa04a47cac600/0x5757cd208ac37ced lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x5757cd208ac37cf4 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788841233.919402:0:17960:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788841233.919405:0:17960:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788841233.919414:0:17960:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788841233.919431:0:17960:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.107@tcp lock: ffffa04a47cac600/0x5757cd208ac37ced lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5757cd208ac37cf4 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841233.919437:0:17960:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788841233.919451:0:17960:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.107@tcp lock: ffffa04a47cac600/0x5757cd208ac37ced lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5757cd208ac37cf4 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841233.919458:0:17960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.107@tcp lock: ffffa04a47cac600/0x5757cd208ac37ced lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5757cd208ac37cf4 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841233.919467:0:17960:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788841233.919471:0:17960:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.107@tcp lock: ffffa04b81b5c600/0x5757cd208ac37736 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5757cd208ac3773d expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841233.919476:0:17960:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b81b5c600 already unused, calling callback (ffffffffc11a4c20) 10000000:00010000:0.0:1788841233.919478:0:17960:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.107@tcp lock: ffffa04b81b5c600/0x5757cd208ac37736 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5757cd208ac3773d expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841233.919484:0:17960:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.107@tcp lock: ffffa04b81b5c600/0x5757cd208ac37736 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5757cd208ac3773d expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788841233.919490:0:17960:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.107@tcp lock: ffffa04b81b5c600/0x5757cd208ac37736 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5757cd208ac3773d expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788841233.919494:0:17960:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788841233.919496:0:17960:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788841233.919497:0:17960:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788841233.919511:0:17960:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.107@tcp lock: ffffa04b81b5c600/0x5757cd208ac37736 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5757cd208ac3773d expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841233.919516:0:17960:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788841233.919528:0:17960:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.107@tcp lock: ffffa04b81b5c600/0x5757cd208ac37736 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5757cd208ac3773d expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841233.919534:0:17960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.107@tcp lock: ffffa04b81b5c600/0x5757cd208ac37736 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5757cd208ac3773d expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841233.919544:0:17960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841233.919546:0:17960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841233.919547:0:17960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788841233.919565:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c029c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ab398079-8cf9-457a-bcc0-cfc99d2f260b:3652:1875735413494272:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788841233.919633:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841233.919681:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788841233.919687:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c02b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ab398079-8cf9-457a-bcc0-cfc99d2f260b:3652:1875735413494144:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788841233.919709:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841233.919733:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c028000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ab398079-8cf9-457a-bcc0-cfc99d2f260b:3650:1875735413494528:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788841233.919753:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841233.919868:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788841233.919877:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c029500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ab398079-8cf9-457a-bcc0-cfc99d2f260b:3650:1875735413494400:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788841233.919901:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841233.919936:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413494272 00000100:00100000:0.0:1788841233.919943:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413494272 00000100:00100000:0.0:1788841233.919977:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413494144 00000100:00100000:0.0:1788841233.919979:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413494144 00000100:00100000:0.0:1788841233.919987:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413494528 00000100:00100000:0.0:1788841233.919990:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413494528 00000100:00100000:0.0:1788841233.919999:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413494400 00000100:00100000:0.0:1788841233.920001:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413494400 00000100:00100000:0.0:1788841233.920015:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788841233.920023:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7c028e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab398079-8cf9-457a-bcc0-cfc99d2f260b+26:3652:x1875735413494272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788841233.920045:0:17193:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788841233.920060:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa04a47e42400/0x5757cd208ac37b57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5757cd208ac37b50 expref: 26 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841233.920072:0:17193:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788841233.920117:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7c028e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab398079-8cf9-457a-bcc0-cfc99d2f260b+25:3652:x1875735413494272:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841233.920124:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788841233.920141:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788841233.920147:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7c02a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab398079-8cf9-457a-bcc0-cfc99d2f260b+24:3652:x1875735413494144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788841233.920154:0:17193:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788841233.920164:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa04a47caca00/0x5757cd208ac3774b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5757cd208ac37744 expref: 24 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841233.920172:0:17193:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788841233.920193:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7c02a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab398079-8cf9-457a-bcc0-cfc99d2f260b+23:3652:x1875735413494144:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841233.920200:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788841233.920212:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788841233.920217:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7c028a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab398079-8cf9-457a-bcc0-cfc99d2f260b+22:3650:x1875735413494528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788841233.920224:0:17193:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788841233.920233:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa04a47cac200/0x5757cd208ac3773d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5757cd208ac37736 expref: 22 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841233.920241:0:17193:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788841233.920267:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7c028a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab398079-8cf9-457a-bcc0-cfc99d2f260b+21:3650:x1875735413494528:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841233.920281:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788841233.920295:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788841233.920301:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7c028700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab398079-8cf9-457a-bcc0-cfc99d2f260b+20:3650:x1875735413494400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788841233.920309:0:17193:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788841233.920317:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa04b67bb3600/0x5757cd208ac37cf4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5757cd208ac37ced expref: 20 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841233.920325:0:17193:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788841233.920346:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7c028700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab398079-8cf9-457a-bcc0-cfc99d2f260b+19:3650:x1875735413494400:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841233.920351:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788841233.920392:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c029500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ab398079-8cf9-457a-bcc0-cfc99d2f260b:3650:1875735413494400:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788841233.920401:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c028000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ab398079-8cf9-457a-bcc0-cfc99d2f260b:3650:1875735413494528:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788841233.920428:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c02b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ab398079-8cf9-457a-bcc0-cfc99d2f260b:3652:1875735413494144:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788841233.920435:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c029c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ab398079-8cf9-457a-bcc0-cfc99d2f260b:3652:1875735413494272:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788841233.920692:0:17195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788841233.920711:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875735413494016:0@lo:39:umount.0 00000100:00100000:2.0:1788841233.920761:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841233.920810:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413494016 00000100:00100000:2.0:1788841233.920815:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413494016 00000100:00100000:2.0:1788841233.920877:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788841233.920885:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b491d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875735413494016:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788841233.920908:0:17212:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac3793c 00000100:00080000:2.0:1788841233.920915:0:17212:0:(import.c:65:import_set_state_nolock()) ffffa04b7cea6000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788841233.920934:0:17212:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1788841233.921038:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b491d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3648:x1875735413494016:12345-0@lo:39:umount.0 Request processed in 154us (276us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788841233.921045:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1788841233.921097:0:3648:0:(import.c:65:import_set_state_nolock()) ffffa04b48483800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788841233.921105:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875735413494016:0@lo:39:umount.0 00010000:00010000:2.0:1788841233.921126:0:17960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841233.921324:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788841233.921627:0:20779:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788841233.921631:0:20779:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:0.0:1788841233.921806:0:20779:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788841233.921895:0:20779:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788841233.921914:0:20779:0:(import.c:65:import_set_state_nolock()) ffffa04b7f875000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788841233.921930:0:20779:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788841233.921933:0:20779:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:0.0:1788841233.921944:0:20779:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788841233.922004:0:20779:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788841233.922011:0:20779:0:(import.c:65:import_set_state_nolock()) ffffa04b50bb8000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1788841233.922063:0:20779:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffffa04a47c819b8) has no exports 00000100:00100000:2.0:1788841233.922365:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c029c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875735413494656:0@lo:9:umount.0 00000100:00100000:2.0:1788841233.922418:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841233.922451:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c02b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875735413494784:0@lo:9:umount.0 00000100:00100000:2.0:1788841233.922470:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841233.922503:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413494656 00000100:00100000:2.0:1788841233.922508:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413494656 00000100:00100000:2.0:1788841233.922539:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413494784 00000100:00100000:2.0:1788841233.922541:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413494784 00000100:00100000:2.0:1788841233.922556:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788841233.922563:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b491d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875735413494656:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788841233.922583:0:18715:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac37a07 00000100:00080000:2.0:1788841233.922590:0:18715:0:(import.c:65:import_set_state_nolock()) ffffa04b7f86c800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788841233.922626:0:18715:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1788841233.922758:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b491d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3648:x1875735413494656:12345-0@lo:9:umount.0 Request processed in 194us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841233.922774:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788841233.922789:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788841233.922795:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b491d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875735413494784:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788841233.922804:0:18715:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac37b5e 00000100:00080000:2.0:1788841233.922809:0:18715:0:(import.c:65:import_set_state_nolock()) ffffa04a4745d000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788841233.922827:0:18715:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:2.0:1788841233.922907:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b491d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3648:x1875735413494784:12345-0@lo:9:umount.0 Request processed in 112us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841233.922913:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:2.0:1788841233.922932:0:17195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841233.922937:0:17960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788841233.922964:0:3648:0:(import.c:65:import_set_state_nolock()) ffffa04b7f875000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788841233.923734:0:3648:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788841233.923739:0:3648:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788841233.923744:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c029c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875735413494656:0@lo:9:umount.0 00000100:00080000:2.0:1788841233.923763:0:3648:0:(import.c:65:import_set_state_nolock()) ffffa04b50bb8000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788841233.924030:0:3648:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788841233.924032:0:3648:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788841233.924036:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c02b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875735413494784:0@lo:9:umount.0 00000020:00080000:0.0:1788841233.931319:0:20779:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffffa04a47c819b8) has no exports 00000020:00000080:0.0:1788841234.019476:0:20779:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac37791 00000020:00000080:0.0:1788841234.019492:0:20779:0:(genops.c:885:class_export_put()) final put ffffa04b527e3000/lustre-QMT0000_UUID 00000020:01000000:0.0:1788841234.021962:0:20779:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1788841234.022090:0:20779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788841234.022102:0:20779:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788841234.022106:0:20779:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffffa04b46de8000) has no exports 00000020:00000080:1.0:1788841234.022948:0:20779:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac3778a 00000020:00000080:1.0:1788841234.022957:0:20779:0:(genops.c:885:class_export_put()) final put ffffa04a47c68000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788841234.030929:0:11140:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b527e3000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788841234.031270:0:11140:0:(genops.c:844:class_export_destroy()) destroying export ffffa04a47c68000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788841234.031434:0:20779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788841234.031448:0:20779:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788841234.031454:0:20779:0:(genops.c:885:class_export_put()) final put ffffa04b4851d800/lustre-QMT0000_UUID 00000020:00000080:3.0:1788841234.031458:0:20779:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b4851d800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1788841234.031462:0:20779:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:1.0:1788841234.900462:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841235.919274:0:17195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788841235.984687:0:19528:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788841235.984697:0:19528:0:(genops.c:885:class_export_put()) final put ffffa04a4745c000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788841235.984720:0:19528:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d9869f3a-61f0-4dde-ae0a-6fe2d2b9a51b 00000020:00000080:1.0:1788841235.984722:0:19528:0:(genops.c:885:class_export_put()) final put ffffa04b7f868000/d9869f3a-61f0-4dde-ae0a-6fe2d2b9a51b 00000020:00000080:3.0:1788841235.984756:0:11140:0:(genops.c:844:class_export_destroy()) destroying export ffffa04a4745c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788841235.984809:0:11140:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b7f868000/d9869f3a-61f0-4dde-ae0a-6fe2d2b9a51b for lustre-OST0001 00000020:00000080:3.0:1788841235.984859:0:11140:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa04a4745d000 for lustre-OST0001 00000020:00000080:3.0:1788841235.984865:0:11140:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa04b7f869800 for lustre-OST0001 00000001:00100000:3.0:1788841235.985857:0:17186:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788841235.985863:0:17186:0:(genops.c:885:class_export_put()) final put ffffa04a47d04800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1788841235.985886:0:17186:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 05b5e23c-fb41-484b-af6b-585a3a9027d2 00000001:00080000:3.0:1788841235.985893:0:17186:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934638 is committed 00000020:00000080:3.0:1788841235.985897:0:17186:0:(genops.c:885:class_export_put()) final put ffffa04b47814800/05b5e23c-fb41-484b-af6b-585a3a9027d2 00000001:00100000:3.0:1788841235.985902:0:17186:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d9869f3a-61f0-4dde-ae0a-6fe2d2b9a51b 00000001:00080000:3.0:1788841235.985908:0:17186:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934637 is committed 00000020:00000080:3.0:1788841235.985909:0:17186:0:(genops.c:885:class_export_put()) final put ffffa04a47c7a000/d9869f3a-61f0-4dde-ae0a-6fe2d2b9a51b 00000020:00000080:0.0:1788841235.985965:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa04a47d04800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1788841235.986032:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b47814800/05b5e23c-fb41-484b-af6b-585a3a9027d2 for lustre-MDT0000 00000020:00000080:0.0:1788841235.986068:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa04a47c7a000/d9869f3a-61f0-4dde-ae0a-6fe2d2b9a51b for lustre-MDT0000 00000020:00000080:0.0:1788841235.986095:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa04a47d07800 for lustre-MDT0000 00000020:00000080:0.0:1788841235.986100:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa04b47810800 for lustre-MDT0000 00000020:00000080:0.0:1788841235.986103:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa04b7cbb1000 for lustre-MDT0000 00000001:00100000:0.0:1788841235.987504:0:17940:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788841235.987518:0:17940:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:0.0:1788841235.987523:0:17940:0:(genops.c:885:class_export_put()) final put ffffa04b43017000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788841235.987546:0:17940:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 05b5e23c-fb41-484b-af6b-585a3a9027d2 00000001:00080000:0.0:1788841235.987550:0:17940:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:0.0:1788841235.987553:0:17940:0:(genops.c:885:class_export_put()) final put ffffa04b47813000/05b5e23c-fb41-484b-af6b-585a3a9027d2 00000001:00100000:0.0:1788841235.987558:0:17940:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of d9869f3a-61f0-4dde-ae0a-6fe2d2b9a51b 00000001:00080000:0.0:1788841235.987562:0:17940:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:0.0:1788841235.987564:0:17940:0:(genops.c:885:class_export_put()) final put ffffa04b7cbb2800/d9869f3a-61f0-4dde-ae0a-6fe2d2b9a51b 00000020:00000080:3.0:1788841235.987623:0:11140:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b43017000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1788841235.987689:0:11140:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b47813000/05b5e23c-fb41-484b-af6b-585a3a9027d2 for lustre-MDT0001 00000020:00000080:3.0:1788841235.987712:0:11140:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b7cbb2800/d9869f3a-61f0-4dde-ae0a-6fe2d2b9a51b for lustre-MDT0001 00000020:00000080:3.0:1788841235.987734:0:11140:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa04b7cea6000 for lustre-MDT0001 00000020:00000080:3.0:1788841235.987738:0:11140:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa04b47812000 for lustre-MDT0001 00000020:00000080:3.0:1788841235.987741:0:11140:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa04b7cbb0800 for lustre-MDT0001 00000020:01000000:0.0:1788841236.045710:0:20779:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa04b76045240 - data ffffa04b70a97438/ffffa04b7cb79800 00000020:01000000:0.0:1788841236.045907:0:20779:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa04b46b0d7e0 - data ffffa04b709beaf8/ffffa04b46e03400 00000001:00000004:0.0:1788841236.054811:0:20779:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934638 00000100:00080000:1.0:1788841236.102782:0:20779:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788841236.102792:0:20779:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788841236.102806:0:20779:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffffa04b6e05ed80 x1875735413494016/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788841243 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788841236.102867:0:20779:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1788841236.106629:0:20779:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788841236.106640:0:20779:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:1.0:1788841236.107084:0:20779:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788841236.107088:0:20779:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788841236.107668:0:17230:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788841236.107685:0:17230:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:3.0:1788841236.107694:0:17230:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:1.0:1788841236.108537:0:20779:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788841236.108543:0:20779:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:1.0:1788841236.108578:0:20779:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788841236.108581:0:20779:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788841236.108911:0:17232:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788841236.108916:0:17232:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:2.0:1788841236.108925:0:17232:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:1.0:1788841236.110299:0:20779:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac37759 00000020:00000080:1.0:1788841236.110311:0:20779:0:(genops.c:885:class_export_put()) final put ffffa04b48482800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788841236.110731:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b48482800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788841236.113859:0:20779:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac3776e 00000020:00000080:1.0:1788841236.113874:0:20779:0:(genops.c:885:class_export_put()) final put ffffa04b48482000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788841236.113893:0:20779:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788841236.113898:0:20779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788841236.113907:0:20779:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788841236.113911:0:20779:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffffa04a47c83370) has no exports 00000004:01000000:1.0:1788841236.114096:0:20779:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788841236.114104:0:20779:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac377d0 00000020:00000080:1.0:1788841236.114117:0:20779:0:(genops.c:885:class_export_put()) final put ffffa04b527e5000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788841236.114120:0:20779:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788841236.114123:0:20779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788841236.114127:0:20779:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788841236.114130:0:20779:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffffa04b81afb370) has no exports 00000020:00000080:1.0:1788841236.114136:0:20779:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac377c9 00000020:00000080:1.0:1788841236.114139:0:20779:0:(genops.c:885:class_export_put()) final put ffffa04b527e2800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788841236.114304:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b48482000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1788841236.114313:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b527e5000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788841236.114319:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b527e2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788841236.114956:0:20779:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788841236.114961:0:20779:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788841236.114965:0:20779:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:2.0:1788841236.114971:0:20779:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788841236.114973:0:20779:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788841236.115011:0:20779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788841236.115018:0:20779:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788841236.115024:0:20779:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac377bb 00000020:00000080:2.0:1788841236.115029:0:20779:0:(genops.c:885:class_export_put()) final put ffffa04b527e7000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788841236.115033:0:20779:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788841236.115046:0:20779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788841236.115049:0:20779:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788841236.115052:0:20779:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffffa04b6e0ccd28) has no exports 00000020:00000080:2.0:1788841236.115068:0:20779:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac377b4 00000020:00000080:2.0:1788841236.115071:0:20779:0:(genops.c:885:class_export_put()) final put ffffa04b7f875800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1788841236.115779:0:20779:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788841236.115783:0:20779:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788841236.115785:0:20779:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:2.0:1788841236.115789:0:20779:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788841236.115791:0:20779:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788841236.115814:0:20779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788841236.115819:0:20779:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1788841236.115829:0:20779:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788841236.115848:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa04b50bb8000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788841236.115856:0:36:0:(genops.c:885:class_export_put()) final put ffffa04b527e2000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788841236.115858:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b527e2000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788841236.115858:0:20779:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac377a6 00000020:00000080:2.0:1788841236.115863:0:20779:0:(genops.c:885:class_export_put()) final put ffffa04b7f876000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788841236.115864:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788841236.115873:0:20779:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1788841236.115876:0:20779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788841236.115881:0:20779:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788841236.115883:0:20779:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffffa04b46decd28) has no exports 00000020:00000080:2.0:1788841236.115887:0:20779:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac3779f 00000020:00000080:2.0:1788841236.115889:0:20779:0:(genops.c:885:class_export_put()) final put ffffa04a47c6e800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788841236.115952:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b527e7000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788841236.115957:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b7f875800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788841236.115961:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa04b7f875000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788841236.115965:0:36:0:(genops.c:885:class_export_put()) final put ffffa04b7f871800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788841236.115966:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b7f871800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1788841236.115969:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788841236.115995:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b7f876000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788841236.115999:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa04a47c6e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788841236.123904:0:20779:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:3.0:1788841236.123913:0:20779:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788841236.123918:0:20779:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788841236.123926:0:20779:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788841236.123993:0:20779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788841236.124008:0:20779:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788841236.124047:0:20779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788841236.124051:0:20779:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788841236.124056:0:20779:0:(genops.c:885:class_export_put()) final put ffffa04b48481800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788841236.124061:0:20779:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b48481800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788841236.124069:0:20779:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788841236.124249:0:11140:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa04b48483800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788841236.124257:0:11140:0:(genops.c:885:class_export_put()) final put ffffa04a47c6f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788841236.124259:0:11140:0:(genops.c:844:class_export_destroy()) destroying export ffffa04a47c6f800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1788841236.124268:0:11140:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788841236.124430:0:20779:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac37775 00000020:00000080:3.0:1788841236.124440:0:20779:0:(genops.c:885:class_export_put()) final put ffffa04b48481000/lustre-MDD0000_UUID 00000020:01000000:3.0:1788841236.124455:0:20779:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1788841236.124474:0:20779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788841236.124482:0:20779:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788841236.124487:0:20779:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffffa04a47c80000) has no exports 00000020:00000080:3.0:1788841236.124509:0:20779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788841236.124513:0:20779:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1788841236.124519:0:20779:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac3777c 00000020:00000080:3.0:1788841236.124523:0:20779:0:(genops.c:885:class_export_put()) final put ffffa04b48485000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788841236.124534:0:20779:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa04a488fa800 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1788841236.124538:0:20779:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa04a488fa800 3 00000020:01000004:3.0:1788841236.124543:0:20779:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffffa04a488fa800 from lustre-MDT0000 00000020:00000080:3.0:1788841236.124565:0:20779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788841236.124569:0:20779:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1788841236.124572:0:20779:0:(genops.c:885:class_export_put()) final put ffffa04b48486000/lustre-MDT0000_UUID 00000020:00000080:3.0:1788841236.124575:0:20779:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b48486000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1788841236.124584:0:20779:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1788841236.124620:0:20779:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:3.0:1788841236.124625:0:20779:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1788841236.124628:0:20779:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1788841236.124631:0:20779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788841236.124634:0:20779:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788841236.124642:0:20779:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffffa04a48b34000 ab398079-8cf9-457a-bcc0-cfc99d2f260b 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788841236.124648:0:20779:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffffa04b81af99b8) has exports, disconnecting them 00000020:00080000:3.0:1788841236.124654:0:20779:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffffa04a48b34000), last request at 1788841138 00000020:00000080:3.0:1788841236.124673:0:20779:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac37721 00000020:00010000:3.0:1788841236.124677:0:20779:0:(genops.c:1921:obd_stale_export_put()) Put export ffffa04a48b34000: total 2 00000100:00080000:3.0:1788841236.124680:0:20779:0:(import.c:65:import_set_state_nolock()) ffffa04a48b37000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788841236.124699:0:20779:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa04a48b34000): rc 0 00000020:00080000:3.0:1788841236.124703:0:20779:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffffa04b81af99b8) has no exports 00000100:00100000:3.0:1788841236.124783:0:17200:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffffa04b600a3200:17200] 1 exiting: rc = 0 00000020:00010000:3.0:1788841236.124941:0:17960:0:(genops.c:1907:obd_stale_export_get()) Get export ffffa04a48b34000: total 2 00010000:00010000:3.0:1788841236.124946:0:17960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841236.124972:0:17960:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffffa04a48b34000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1788841236.125012:0:17960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa04a47cadc00/0x5757cd208ac37cca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5757cd208ac37cc3 expref: 14 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841236.125031:0:17960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa04a47e43a00/0x5757cd208ac37840 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5757cd208ac37839 expref: 13 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841236.125056:0:17960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa04a47cac000/0x5757cd208ac379ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5757cd208ac379a5 expref: 12 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841236.125066:0:17960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa04b81b5ca00/0x5757cd208ac378fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5757cd208ac378f6 expref: 11 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841236.125077:0:17960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa04b81b5de00/0x5757cd208ac3784e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5757cd208ac37847 expref: 10 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841236.125089:0:17960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa04b67bb3200/0x5757cd208ac37cd8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5757cd208ac37cd1 expref: 9 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841236.125098:0:17960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa04b7f8c4400/0x5757cd208ac37ce6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5757cd208ac37cdf expref: 8 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841236.125109:0:17960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa04b81b5ce00/0x5757cd208ac3785c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5757cd208ac37855 expref: 7 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841236.125118:0:17960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa04a47e43e00/0x5757cd208ac37b0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5757cd208ac37b03 expref: 6 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841236.125128:0:17960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa04b7f8c5000/0x5757cd208ac3772f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5757cd208ac37728 expref: 5 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841236.125138:0:17960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa04b7f8c4800/0x5757cd208ac37b49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5757cd208ac37b42 expref: 4 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841236.125230:0:17960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa04a47e42c00/0x5757cd208ac37982 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5757cd208ac3797b expref: 3 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841236.125242:0:17960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa04b7f8c5400/0x5757cd208ac37ae0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5757cd208ac37ad9 expref: 2 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841236.125252:0:17960:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffffa04a48b34000, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1788841236.125269:0:17960:0:(genops.c:885:class_export_put()) final put ffffa04a48b34000/ab398079-8cf9-457a-bcc0-cfc99d2f260b 00010000:00010000:3.0:1788841236.125274:0:17960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841236.125276:0:17960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841236.125277:0:17960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788841236.125418:0:17198:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffffa04b710c5a00:17198] 0 exiting: rc = 1 00000020:00000080:1.0:1788841236.125461:0:11140:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b48481000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788841236.125465:0:11140:0:(genops.c:885:class_export_put()) final put ffffa04b48487800/lustre-MDD0000_UUID 00000020:00000080:1.0:1788841236.125467:0:11140:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b48487800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788841236.125476:0:11140:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788841236.125523:0:11140:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b48485000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788841236.125527:0:11140:0:(genops.c:844:class_export_destroy()) destroying export ffffa04a48b34000/ab398079-8cf9-457a-bcc0-cfc99d2f260b for MGS 00000020:00000080:1.0:1788841236.125558:0:11140:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa04a48b37000 for MGS 00000100:00100000:1.0:1788841236.127182:0:17201:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffffa04a47607000:17201] 2 exiting: rc = 0 00000100:00100000:3.0:1788841236.127406:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127413:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127419:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127425:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127432:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127438:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127443:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127448:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127453:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127458:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127464:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127468:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127473:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127479:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127483:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127488:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127493:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127498:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127503:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127508:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127525:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127530:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127534:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127539:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127544:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127556:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127562:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127568:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127573:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127579:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127584:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127590:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127595:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127600:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127605:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127610:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127615:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127619:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127624:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127629:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127634:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127638:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127646:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127652:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127658:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127663:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127667:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127673:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127679:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127684:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127689:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127694:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127700:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127707:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127713:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127728:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127734:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127739:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127744:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127749:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127755:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127760:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127766:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841236.127774:0:20779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:3.0:1788841236.130504:0:20779:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa04a45db9a20 - data ffffa04b70896000/ffffa04a47963400 00000020:01000000:3.0:1788841236.130621:0:20779:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa04a46b49180 - data ffffa04b7081f870/ffffa04b4765e400 00000020:00000080:3.0:1788841236.131056:0:20779:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac37705 00000020:00000080:3.0:1788841236.131066:0:20779:0:(genops.c:885:class_export_put()) final put ffffa04b43017800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788841236.131087:0:20779:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa04a488fa800 from MGS, refs=2 00000020:01000004:3.0:1788841236.131091:0:20779:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa04a488fa800 2 00000020:01000004:3.0:1788841236.131094:0:20779:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffffa04a488fa800 from MGS 00000020:00000080:3.0:1788841236.131122:0:20779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788841236.131122:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b43017800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788841236.131128:0:20779:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788841236.131130:0:20779:0:(genops.c:885:class_export_put()) final put ffffa04b43013000/MGS 00000020:00000080:3.0:1788841236.131133:0:20779:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b43013000/MGS for MGS 00000020:01000000:3.0:1788841236.131138:0:20779:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1788841236.131216:0:20779:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1788841236.131219:0:20779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788841236.131225:0:20779:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788841236.131231:0:20779:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffffa04b6dc6f000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788841236.131237:0:20779:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffffa04b7f7799b8) has exports, disconnecting them 00000020:00080000:3.0:1788841236.131241:0:20779:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffffa04b6dc6f000), last request at 1788841139 00000020:00000080:3.0:1788841236.131245:0:20779:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac37808 00000020:00080000:3.0:1788841236.131254:0:20779:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa04b6dc6f000): rc 0 00000020:00000080:3.0:1788841236.131257:0:20779:0:(genops.c:885:class_export_put()) final put ffffa04b6dc6f000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788841236.131342:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b6dc6f000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788841236.189960:0:20779:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788841236.189969:0:20779:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788841236.189973:0:20779:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788841236.189987:0:20779:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788841236.190301:0:20779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788841236.190312:0:20779:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788841236.190320:0:20779:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa04a488fa800 1 00000020:00000080:2.0:1788841236.190327:0:20779:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac376f7 00000020:00000080:2.0:1788841236.190337:0:20779:0:(genops.c:885:class_export_put()) final put ffffa04b43016800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788841236.190450:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa04b6dc6f800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788841236.190458:0:36:0:(genops.c:885:class_export_put()) final put ffffa04b6dc61800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788841236.190461:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b6dc61800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788841236.190472:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:2.0:1788841236.190676:0:20779:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788841236.190682:0:20779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788841236.190688:0:20779:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788841236.190691:0:20779:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffffa04b6e0c8000) has no exports 00000020:00000080:1.0:1788841236.191106:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b43016800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788841236.292559:0:20779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788841236.292573:0:20779:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788841236.292580:0:20779:0:(genops.c:885:class_export_put()) final put ffffa04a488fb800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788841236.292585:0:20779:0:(genops.c:844:class_export_destroy()) destroying export ffffa04a488fb800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788841236.292599:0:20779:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788841236.292722:0:20779:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffffa04a488fc000 00000020:02000400:0.0:1788841236.292786:0:20779:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:2.0:1788841236.496284:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b491d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875735413494912:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788841236.496367:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841236.496426:0:18209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413494912 00000100:00100000:2.0:1788841236.496433:0:18209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413494912 00000100:00100000:2.0:1788841236.496470:0:18209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788841236.496477:0:18209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b491d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3651:x1875735413494912:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1788841236.496485:0:18209:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788841236.496526:0:18209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b491d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3651:x1875735413494912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 48us (159us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788841236.496533:0:18209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:02020000:2.0:1788841236.496569:0:3651:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00100000:1.0:1788841236.496873:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6d9e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875735413495040:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788841236.496906:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841236.497678:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413495040 00000100:00100000:1.0:1788841236.497685:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413495040 00000100:00100000:1.0:1788841236.498229:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788841236.498240:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6d9e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875735413495040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788841236.498271:0:18718:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788841236.498332:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6d9e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875735413495040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (1425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841236.498339:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1788841236.498360:0:17202:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788841236.498397:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6d9e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875735413495040:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788841236.520528:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788841236.520535:0:3651:0:(import.c:65:import_set_state_nolock()) ffffa04b6dfd6000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788841236.520540:0:3651:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788841236.554516:0:3651:0:(import.c:65:import_set_state_nolock()) ffffa04b6dfd6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788841236.554530:0:3651:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 588 00000100:00080000:2.0:1788841236.554541:0:3651:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffffa04b6dfd6000 using connection 192.168.204.107@tcp/0@lo 00000100:00100000:3.0:1788841236.555928:0:3651:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa04b6e05f800 x1875735413495168/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788841236.557505:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875735413495168:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1788841236.557591:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841236.558561:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413495168 00000100:00100000:2.0:1788841236.558569:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413495168 00000100:00100000:2.0:1788841236.559040:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788841236.559048:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b491d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1875735413495168:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1788841236.559072:0:17211:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788841236.599722:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b491d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1875735413495168:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 40662us (42119us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788841236.599747:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1788841236.599801:0:3648:0:(import.c:65:import_set_state_nolock()) ffffa04b6dfd6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788841236.599807:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788841236.599811:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875735413495168:0@lo:38:ptlrpcd_00_02.0 00000040:00080000:0.0:1788841236.623938:0:17962:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788841236.941983:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841237.964990:0:17195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788841238.542712:0:11140:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788841238.542719:0:11140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788841238.542724:0:11140:0:(import.c:65:import_set_state_nolock()) ffffa04b6dfd6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788841238.542733:0:11140:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 670 00000100:00080000:1.0:1788841238.542738:0:11140:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788841238.542753:0:11140:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffffa04b6dfd6000 using connection 192.168.204.107@tcp/0@lo 00000100:00100000:1.0:1788841238.542777:0:11140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa04b6d9e0700 x1875735413495424/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788841238.542886:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6d9e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ab398079-8cf9-457a-bcc0-cfc99d2f260b:3649:1875735413495296:0@lo:400:kworker.0 00000400:00000100:1.0:1788841238.542943:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875735413495296 offset 0 length 224: 4 00000100:00100000:1.0:1788841238.543015:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6d9e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875735413495936:0@lo:400:kworker.0 00000100:00100000:1.0:1788841238.543054:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841238.543087:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788841238.543093:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6d9e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875735413495552:0@lo:400:kworker.0 00000100:00100000:1.0:1788841238.543118:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841238.543137:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6d9e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1875735413496064:0@lo:400:kworker.0 00000100:00100000:1.0:1788841238.543158:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841238.543186:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6d9e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875735413495424:0@lo:38:kworker.0 00000100:00100000:1.0:1788841238.543212:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841238.543239:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6d9e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875735413495808:0@lo:400:kworker.0 00000100:00100000:1.0:1788841238.543262:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841238.543276:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6d9e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1875735413496320:0@lo:400:kworker.0 00000100:00100000:1.0:1788841238.543294:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841238.543310:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788841238.543315:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6d9e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875735413495680:0@lo:400:kworker.0 00000100:00100000:1.0:1788841238.543337:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841238.543356:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6d9e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1875735413496192:0@lo:400:kworker.0 00000100:00100000:1.0:1788841238.543376:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841238.543398:0:20345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413495936 00000100:00100000:1.0:1788841238.543414:0:20345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413495936 00000100:00100000:1.0:1788841238.543479:0:20345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413496064 00000100:00100000:1.0:1788841238.543482:0:20345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413496064 00000100:00100000:1.0:1788841238.543513:0:20345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413495808 00000100:00100000:1.0:1788841238.543516:0:20345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413495808 00000100:00100000:1.0:1788841238.543523:0:20345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413496320 00000100:00100000:1.0:1788841238.543525:0:20345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413496320 00000100:00100000:1.0:1788841238.543536:0:20345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413496192 00000100:00100000:1.0:1788841238.543538:0:20345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413496192 00000100:00100000:1.0:1788841238.543550:0:20345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788841238.543559:0:20345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6d9e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875735413496064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841238.543610:0:20345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6d9e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875735413496064:12345-0@lo:400:kworker.0 Request processed in 52us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841238.543617:0:20345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788841238.543634:0:20345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788841238.543640:0:20345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6d9e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875735413496320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841238.543672:0:20345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6d9e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875735413496320:12345-0@lo:400:kworker.0 Request processed in 32us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841238.543678:0:20345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788841238.543690:0:20345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788841238.543694:0:20345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6d9e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875735413495936:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788841238.543699:0:20345:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788841238.543725:0:20345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6d9e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875735413495936:12345-0@lo:400:kworker.0 Request processed in 29us (671us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788841238.543730:0:20345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788841238.543743:0:20345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788841238.543746:0:20345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6d9e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3652:x1875735413495808:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788841238.543750:0:20345:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788841238.543779:0:20345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6d9e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3652:x1875735413495808:12345-0@lo:400:kworker.0 Request processed in 31us (515us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788841238.543786:0:20345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788841238.543798:0:20345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788841238.543802:0:20345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7fa07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3652:x1875735413496192:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788841238.543806:0:20345:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788841238.543826:0:20345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7fa07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3652:x1875735413496192:12345-0@lo:400:kworker.0 Request processed in 22us (449us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788841238.543853:0:20345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788841238.543873:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413495552 00000100:00100000:1.0:1788841238.543877:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413495552 00000100:00100000:1.0:1788841238.543903:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413495680 00000100:00100000:1.0:1788841238.543906:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413495680 00000100:00100000:1.0:1788841238.543925:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788841238.543931:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6d9e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875735413495552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841238.543959:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6d9e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875735413495552:12345-0@lo:400:kworker.0 Request processed in 29us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841238.543964:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788841238.543973:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788841238.543977:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6d9e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875735413495680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841238.544355:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788841238.544366:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875735413496448:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788841238.544396:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841238.544424:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413496448 00000100:00100000:3.0:1788841238.544428:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413496448 00000100:00100000:3.0:1788841238.544455:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788841238.544474:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6e05f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3650:x1875735413496448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788841238.544497:0:18718:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788841238.544529:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6e05f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3650:x1875735413496448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841238.544536:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788841238.544576:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875735413496448:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788841238.545213:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6d9e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875735413495680:12345-0@lo:400:kworker.0 Request processed in 1233us (1873us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841238.545221:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788841238.545251:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413495424 00000100:00100000:1.0:1788841238.545254:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413495424 00000100:00100000:1.0:1788841238.545271:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788841238.545276:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6d9e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1875735413495424:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788841238.545293:0:17212:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788841238.545333:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6d9e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1875735413495424:12345-0@lo:38:kworker.0 Request processed in 56us (2120us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788841238.545339:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1788841238.545356:0:17202:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788841238.545360:0:17202:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788841238.545362:0:17202:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788841238.545384:0:3648:0:(import.c:65:import_set_state_nolock()) ffffa04b6dfd6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788841238.545389:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788841238.545392:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6d9e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875735413495424:0@lo:38:kworker.0 00000100:00100000:1.0:1788841238.545414:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6d9e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875735413495680:0@lo:400:kworker.0 00000100:00080000:1.0:1788841238.545424:0:3652:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788841238.545427:0:3652:0:(import.c:65:import_set_state_nolock()) ffffa04a4745b000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788841238.545431:0:3652:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1788841238.553633:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6d9e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875735413495552:0@lo:400:kworker.0 00010000:00080000:0.0:1788841238.553658:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffffa04b6d9e3100 x1875735413496064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841238.553670:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6d9e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1875735413496064:0@lo:400:kworker.0 00000100:00080000:0.0:1788841238.553682:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788841238.553687:0:3649:0:(import.c:65:import_set_state_nolock()) ffffa04a47c7b800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788841238.553692:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788841238.553698:0:3649:0:(import.c:65:import_set_state_nolock()) ffffa04a47c7b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788841238.553701:0:3649:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 604 00000100:00080000:0.0:1788841238.553708:0:3649:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffffa04a47c7b800 using connection 192.168.204.107@tcp/0@lo 00000100:00100000:0.0:1788841238.553744:0:3649:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa04b7c028000 x1875735413496576/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788841238.553766:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6d9e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875735413495936:0@lo:400:kworker.0 00000100:00100000:3.0:1788841238.556405:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c028000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1875735413496576:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788841238.556496:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841238.556558:0:20345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413496576 00000100:00100000:3.0:1788841238.556566:0:20345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413496576 00000100:00100000:3.0:1788841238.556606:0:20345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788841238.556613:0:20345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6e05dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1875735413496576:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1788841238.556635:0:20345:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788841238.556676:0:20345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6e05dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1875735413496576:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 61us (180us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788841238.556684:0:20345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1788841238.556722:0:3648:0:(import.c:65:import_set_state_nolock()) ffffa04a47c7b800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788841238.556727:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788841238.556731:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c028000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1875735413496576:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:1.0:1788841238.576637:0:3652:0:(import.c:65:import_set_state_nolock()) ffffa04a4745b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788841238.576656:0:3652:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 621 00000100:00080000:1.0:1788841238.576670:0:3652:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffffa04a4745b000 using connection 192.168.204.107@tcp/0@lo 00000100:00100000:1.0:1788841238.576714:0:3652:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa04b7fa07b80 x1875735413496704/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788841238.576751:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6d9e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1875735413496192:0@lo:400:kworker.0 00000100:00080000:1.0:1788841238.576792:0:3652:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788841238.576797:0:3652:0:(import.c:65:import_set_state_nolock()) ffffa04b7f866000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788841238.576801:0:3652:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788841238.576804:0:3652:0:(import.c:65:import_set_state_nolock()) ffffa04b7f866000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788841238.576815:0:3652:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 588 00000100:00080000:1.0:1788841238.576819:0:3652:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffffa04b7f866000 using connection 192.168.204.107@tcp/0@lo 00000100:00100000:0.0:1788841238.576900:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fa07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1875735413496704:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1788841238.576966:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841238.577049:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413496704 00000100:00100000:0.0:1788841238.577067:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413496704 00000100:00100000:0.0:1788841238.577112:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788841238.577121:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7c029500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1875735413496704:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:0.0:1788841238.577143:0:17206:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788841238.577194:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7c029500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1875735413496704:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 73us (228us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788841238.577202:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:0.0:1788841238.577239:0:3648:0:(import.c:65:import_set_state_nolock()) ffffa04a4745b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788841238.577244:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788841238.577247:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fa07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1875735413496704:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788841238.585282:0:3652:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa04b6d9e3b80 x1875735413496832/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788841238.585323:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6d9e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875735413495808:0@lo:400:kworker.0 00010000:00080000:1.0:1788841238.585366:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffffa04b6d9e2680 x1875735413496320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788841238.585378:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6d9e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1875735413496320:0@lo:400:kworker.0 00000100:00100000:0.0:1788841238.585806:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6d9e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875735413496832:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1788841238.585899:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841238.586243:0:20345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413496832 00000100:00100000:3.0:1788841238.586250:0:20345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413496832 00000100:00100000:3.0:1788841238.586296:0:20345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788841238.586304:0:20345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7c02bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1875735413496832:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:3.0:1788841238.586326:0:20345:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788841238.586382:0:20345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7c02bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1875735413496832:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 77us (482us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788841238.586389:0:20345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:1.0:1788841238.586569:0:3648:0:(import.c:65:import_set_state_nolock()) ffffa04b7f866000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788841238.586575:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788841238.586578:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6d9e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875735413496832:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:3.0:1788841238.993672:0:17960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788841239.575906:0:18711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788841239.575919:0:18711:0:(genops.c:885:class_export_put()) final put ffffa04b7f86f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788841239.582107:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b7f86f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788841239.582194:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa04b7f86c800 for lustre-OST0000 00010000:00010000:2.0:1788841240.013922:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788841240.511446:0:20980:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788841240.526294:0:20980:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1788841240.526350:0:20980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04a47e43000/0x5757cd208ac378f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac378fd expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841240.526364:0:20980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04a47e43000/0x5757cd208ac378f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5757cd208ac378fd expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841240.526371:0:20980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04a47e43000/0x5757cd208ac378f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x5757cd208ac378fd expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841240.526379:0:20980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.107@tcp lock: ffffa04a47e43000/0x5757cd208ac378f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x5757cd208ac378fd expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841240.526444:0:20980:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788841240.526451:0:20980:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788841240.526481:0:20980:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788841240.526487:0:20980:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788841240.526494:0:20980:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788841240.526516:0:20980:0:(import.c:65:import_set_state_nolock()) ffffa04b7f866000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1788841240.526533:0:20980:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788841240.526535:0:20980:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788841240.526539:0:20980:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788841240.529285:0:17195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788841240.529297:0:17195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.107@tcp lock: ffffa04a47e43000/0x5757cd208ac378f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x5757cd208ac378fd expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841240.529309:0:17195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a47e43000 already unused, calling callback (ffffffffc11a4c20) 10000000:00010000:0.0:1788841240.529314:0:17195:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.107@tcp lock: ffffa04a47e43000/0x5757cd208ac378f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x5757cd208ac378fd expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841240.529324:0:17195:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.107@tcp lock: ffffa04a47e43000/0x5757cd208ac378f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x5757cd208ac378fd expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788841240.529332:0:17195:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.107@tcp lock: ffffa04a47e43000/0x5757cd208ac378f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x5757cd208ac378fd expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788841240.529338:0:17195:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788841240.529341:0:17195:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788841240.529344:0:17195:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788841240.529388:0:17195:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.107@tcp lock: ffffa04a47e43000/0x5757cd208ac378f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5757cd208ac378fd expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841240.529395:0:17195:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788841240.529496:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c02b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ab398079-8cf9-457a-bcc0-cfc99d2f260b:3650:1875735413496960:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788841240.529588:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788841240.529783:0:17195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.107@tcp lock: ffffa04a47e43000/0x5757cd208ac378f6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5757cd208ac378fd expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841240.529792:0:17195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.107@tcp lock: ffffa04a47e43000/0x5757cd208ac378f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5757cd208ac378fd expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841240.529805:0:17195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841240.529807:0:17195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841240.529809:0:17195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841240.530242:0:20980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c5c00/0x5757cd208ac37855 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac3785c expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841240.530253:0:20980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c5c00/0x5757cd208ac37855 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5757cd208ac3785c expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841240.530260:0:20980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c5c00/0x5757cd208ac37855 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x5757cd208ac3785c expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841240.530267:0:20980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c5c00/0x5757cd208ac37855 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x5757cd208ac3785c expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841240.530290:0:20980:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788841240.530296:0:20980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04a47e43400/0x5757cd208ac37b42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac37b49 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841240.530302:0:20980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04a47e43400/0x5757cd208ac37b42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5757cd208ac37b49 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841240.530307:0:20980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04a47e43400/0x5757cd208ac37b42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5757cd208ac37b49 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841240.530313:0:20980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.107@tcp lock: ffffa04a47e43400/0x5757cd208ac37b42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5757cd208ac37b49 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841240.530330:0:20980:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788841240.530344:0:20980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c5800/0x5757cd208ac37cdf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac37ce6 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841240.530351:0:20980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c5800/0x5757cd208ac37cdf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5757cd208ac37ce6 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841240.530357:0:20980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c5800/0x5757cd208ac37cdf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5757cd208ac37ce6 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841240.530363:0:20980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c5800/0x5757cd208ac37cdf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5757cd208ac37ce6 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841240.530375:0:20980:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788841240.530387:0:17195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788841240.530390:0:17195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c5c00/0x5757cd208ac37855 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x5757cd208ac3785c expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841240.530397:0:17195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b7f8c5c00 already unused, calling callback (ffffffffc11a4c20) 10000000:00010000:3.0:1788841240.530400:0:17195:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c5c00/0x5757cd208ac37855 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x5757cd208ac3785c expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841240.530407:0:17195:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c5c00/0x5757cd208ac37855 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x5757cd208ac3785c expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788841240.530413:0:17195:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c5c00/0x5757cd208ac37855 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x5757cd208ac3785c expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788841240.530418:0:17195:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788841240.530420:0:17195:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:3.0:1788841240.530437:0:17195:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c5c00/0x5757cd208ac37855 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5757cd208ac3785c expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841240.530451:0:17195:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788841240.530468:0:17195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c5c00/0x5757cd208ac37855 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5757cd208ac3785c expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841240.530474:0:17195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c5c00/0x5757cd208ac37855 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5757cd208ac3785c expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841240.530484:0:17195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788841240.530488:0:17195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.107@tcp lock: ffffa04a47e43400/0x5757cd208ac37b42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5757cd208ac37b49 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841240.530493:0:17195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a47e43400 already unused, calling callback (ffffffffc11a4c20) 10000000:00010000:3.0:1788841240.530495:0:17195:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.107@tcp lock: ffffa04a47e43400/0x5757cd208ac37b42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5757cd208ac37b49 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841240.530502:0:17195:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.107@tcp lock: ffffa04a47e43400/0x5757cd208ac37b42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5757cd208ac37b49 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788841240.530507:0:17195:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.107@tcp lock: ffffa04a47e43400/0x5757cd208ac37b42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5757cd208ac37b49 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788841240.530512:0:17195:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788841240.530514:0:17195:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788841240.530516:0:17195:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788841240.530547:0:17195:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.107@tcp lock: ffffa04a47e43400/0x5757cd208ac37b42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5757cd208ac37b49 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841240.530553:0:17195:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788841240.530559:0:17195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.107@tcp lock: ffffa04a47e43400/0x5757cd208ac37b42 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5757cd208ac37b49 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841240.530578:0:17195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.107@tcp lock: ffffa04a47e43400/0x5757cd208ac37b42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5757cd208ac37b49 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841240.531000:0:17195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788841240.531005:0:17195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c5800/0x5757cd208ac37cdf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5757cd208ac37ce6 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841240.531013:0:17195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b7f8c5800 already unused, calling callback (ffffffffc11a4c20) 10000000:00010000:3.0:1788841240.531016:0:17195:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c5800/0x5757cd208ac37cdf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5757cd208ac37ce6 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841240.531023:0:17195:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c5800/0x5757cd208ac37cdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5757cd208ac37ce6 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788841240.531029:0:17195:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c5800/0x5757cd208ac37cdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5757cd208ac37ce6 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788841240.531033:0:17195:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788841240.531035:0:17195:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788841240.531037:0:17195:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788841240.531058:0:17195:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c5800/0x5757cd208ac37cdf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5757cd208ac37ce6 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841240.531063:0:17195:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788841240.531124:0:17960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841240.531263:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788841240.531508:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788841240.531531:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ab398079-8cf9-457a-bcc0-cfc99d2f260b:3650:1875735413497344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788841240.531609:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841240.531667:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413496960 00000100:00100000:1.0:1788841240.531674:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413496960 00000100:00100000:2.0:1788841240.531687:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ab398079-8cf9-457a-bcc0-cfc99d2f260b:3651:1875735413497088:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788841240.531714:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413497344 00000100:00100000:1.0:1788841240.531717:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413497344 00000100:00100000:2.0:1788841240.531719:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841240.531763:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788841240.531769:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ab398079-8cf9-457a-bcc0-cfc99d2f260b:3651:1875735413497216:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788841240.531792:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788841240.532350:0:17195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c5800/0x5757cd208ac37cdf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5757cd208ac37ce6 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841240.532361:0:17195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c5800/0x5757cd208ac37cdf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5757cd208ac37ce6 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841240.532390:0:17195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841240.532392:0:17195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841240.532394:0:17195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841240.532410:0:20980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c5600/0x5757cd208ac37847 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac3784e expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841240.532419:0:20980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c5600/0x5757cd208ac37847 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5757cd208ac3784e expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841240.532425:0:20980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c5600/0x5757cd208ac37847 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5757cd208ac3784e expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841240.532432:0:20980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c5600/0x5757cd208ac37847 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5757cd208ac3784e expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841240.532480:0:20980:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788841240.532486:0:20980:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:3.0:1788841240.532490:0:20980:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:3.0:1788841240.532537:0:20980:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1788841240.532541:0:20980:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1788841240.532546:0:20980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788841240.532551:0:20980:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1788841240.532556:0:20980:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffffa04a41b1c000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788841240.532562:0:20980:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffffa04b7f6fb800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788841240.532567:0:20980:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffffa04b527d19b8) has exports, disconnecting them 00000020:00080000:3.0:1788841240.532572:0:20980:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffffa04a41b1c000), last request at 1788841238 00000020:00000080:3.0:1788841240.532732:0:20980:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac37b34 00000100:00080000:3.0:1788841240.532759:0:20980:0:(import.c:65:import_set_state_nolock()) ffffa04a41b18000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788841240.532883:0:17960:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788841240.532889:0:17960:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c5600/0x5757cd208ac37847 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5757cd208ac3784e expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841240.532896:0:17960:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b7f8c5600 already unused, calling callback (ffffffffc11a4c20) 10000000:00010000:0.0:1788841240.532899:0:17960:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c5600/0x5757cd208ac37847 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5757cd208ac3784e expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841240.532906:0:17960:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c5600/0x5757cd208ac37847 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5757cd208ac3784e expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788841240.532913:0:17960:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c5600/0x5757cd208ac37847 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5757cd208ac3784e expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788841240.532917:0:17960:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788841240.532920:0:17960:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788841240.532922:0:17960:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788841240.532962:0:17960:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c5600/0x5757cd208ac37847 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5757cd208ac3784e expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841240.532968:0:17960:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788841240.532990:0:17960:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c5600/0x5757cd208ac37847 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5757cd208ac3784e expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841240.532997:0:17960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c5600/0x5757cd208ac37847 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5757cd208ac3784e expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841240.533012:0:17960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841240.533014:0:17960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841240.533016:0:17960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788841240.533030:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c02ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ab398079-8cf9-457a-bcc0-cfc99d2f260b:3650:1875735413497472:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1788841240.533309:0:20980:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa04a41b1c000): rc 0 00000020:00000080:3.0:1788841240.533312:0:20980:0:(genops.c:885:class_export_put()) final put ffffa04a41b1c000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1788841240.533365:0:20980:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffffa04b7f6fb800), last request at 1788841238 00000020:00000080:3.0:1788841240.533370:0:20980:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac379d6 00000100:00080000:3.0:1788841240.533376:0:20980:0:(import.c:65:import_set_state_nolock()) ffffa04b7f6fe800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788841240.533390:0:17195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788841240.533397:0:20980:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa04b7f6fb800): rc 0 00000020:00000080:3.0:1788841240.533399:0:20980:0:(genops.c:885:class_export_put()) final put ffffa04b7f6fb800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1788841240.533425:0:20980:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffbd76c1c5bae0 00000100:00080000:3.0:1788841240.533444:0:20980:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788841240.533451:0:20980:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffffa04b491d3800 x1875735413494912/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788841252 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841240.533462:0:20980:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00010000:00010000:0.0:1788841240.534734:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788841240.535009:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413497088 00000100:00100000:2.0:1788841240.535012:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b491d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875735413494912:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788841240.535018:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413497088 00000100:00100000:2.0:1788841240.535049:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413497216 00000100:00100000:2.0:1788841240.535053:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413497216 00000100:00100000:1.0:1788841240.535057:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788841240.535065:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6d9e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3650:x1875735413496960:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788841240.535067:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788841240.535071:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6d9e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3650:x1875735413497344:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788841240.535071:0:17192:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788841240 with bad export cookie 6293724543924270881 00010000:00020000:2.0:1788841240.535076:0:17193:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788841240 with bad export cookie 6293724543924270881 00000100:00100000:1.0:1788841240.536023:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6d9e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3650:x1875735413496960:12345-0@lo:103:ldlm_bl.0 Request processed in 955us (6441us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788841240.536032:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788841240.536053:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788841240.536057:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47c0c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3651:x1875735413497088:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788841240.536062:0:17192:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788841240 with bad export cookie 6293724543924270881 00000100:00080000:3.0:1788841240.536431:0:20980:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788841240.536438:0:20980:0:(import.c:65:import_set_state_nolock()) ffffa04b6dfd6000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000020:00000080:3.0:1788841240.536496:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa04a41b1c000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1788841240.536558:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b7f6fb800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1788841240.536665:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa04a41b18000 for lustre-MDT0001 00000020:00000080:3.0:1788841240.536671:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa04b7f6fe800 for lustre-MDT0001 00000100:00100000:1.0:1788841240.537216:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47c0c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3651:x1875735413497088:12345-0@lo:103:ldlm_bl.0 Request processed in 1154us (5492us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788841240.537226:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788841240.537249:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788841240.537255:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47b46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3651:x1875735413497216:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788841240.537260:0:17192:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788841240 with bad export cookie 6293724543924270881 00000100:00100000:1.0:1788841240.537295:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47b46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3651:x1875735413497216:12345-0@lo:103:ldlm_bl.0 Request processed in 38us (5502us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788841240.537300:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1788841240.544344:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.107@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788841240.544354:0:3651:0:(import.c:65:import_set_state_nolock()) ffffa04a48b36800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1788841240.544359:0:3651:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.107@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:1.0:1788841240.548041:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788841240.548296:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.107@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788841240.549371:0:20980:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788841240.549378:0:20980:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1788841240.549400:0:20980:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788841240.549462:0:20980:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788841240.549490:0:20980:0:(import.c:65:import_set_state_nolock()) ffffa04b50d1b800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788841240.549507:0:20980:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788841240.549509:0:20980:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1788841240.549519:0:20980:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788841240.549585:0:20980:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788841240.549799:0:20980:0:(import.c:65:import_set_state_nolock()) ffffa04b6dfd7000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788841240.549924:0:20980:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffffa04b527d19b8) has no exports 00000100:00100000:2.0:1788841240.550641:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6d9e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3650:x1875735413497344:12345-0@lo:103:ldlm_bl.0 Request processed in 15563us (19027us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788841240.550712:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788841240.552616:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413497472 00000100:00100000:2.0:1788841240.552627:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413497472 00000100:00100000:2.0:1788841240.552683:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788841240.552692:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6d9e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3650:x1875735413497472:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788841240.552712:0:17191:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788841240 with bad export cookie 6293724543924270881 00000100:00100000:2.0:1788841240.552786:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6d9e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3650:x1875735413497472:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (4754us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788841240.552794:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788841240.552915:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875735413497600:0@lo:9:umount.0 00000100:00100000:2.0:1788841240.552969:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841240.553002:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875735413497728:0@lo:9:umount.0 00000100:00100000:2.0:1788841240.553344:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841240.553423:0:19184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413497600 00000100:00100000:2.0:1788841240.553427:0:19184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413497600 00000100:00100000:2.0:1788841240.553465:0:19184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413497728 00000100:00100000:2.0:1788841240.553468:0:19184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413497728 00000100:00100000:2.0:1788841240.553491:0:19184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788841240.553498:0:19184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47b45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875735413497600:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788841240.553524:0:19184:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac37a00 00000100:00080000:2.0:1788841240.553532:0:19184:0:(import.c:65:import_set_state_nolock()) ffffa04b7f6fb000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788841240.553580:0:19184:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1788841240.553997:0:19184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47b45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3648:x1875735413497600:12345-0@lo:9:umount.0 Request processed in 499us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841240.554005:0:19184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788841240.554214:0:19184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788841240.554224:0:19184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47b44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875735413497728:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788841240.554237:0:19184:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac37b65 00000100:00080000:2.0:1788841240.554243:0:19184:0:(import.c:65:import_set_state_nolock()) ffffa04a4745b800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788841240.554270:0:19184:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:2.0:1788841240.554348:0:19184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47b44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3648:x1875735413497728:12345-0@lo:9:umount.0 Request processed in 127us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841240.554368:0:19184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:2.0:1788841240.554392:0:17960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841240.554398:0:17195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788841240.554425:0:3648:0:(import.c:65:import_set_state_nolock()) ffffa04b50d1b800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788841240.554437:0:3648:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788841240.554439:0:3648:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788841240.554443:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875735413497600:0@lo:9:umount.0 00000100:00080000:2.0:1788841240.554454:0:3648:0:(import.c:65:import_set_state_nolock()) ffffa04b6dfd7000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788841240.554462:0:3648:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788841240.554464:0:3648:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788841240.554466:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875735413497728:0@lo:9:umount.0 00000100:00080000:0.0:1788841240.581353:0:3651:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.107@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788841240.581359:0:3651:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788841240.581370:0:3651:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa04b6d9e2300 x1875735413495296/t0(0) o400->MGC192.168.204.107@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788841254 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841240.581402:0:3651:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa04b7c02b800 x1875735413496960/t0(0) o103->MGC192.168.204.107@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788841256 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841240.581413:0:3651:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa04b6e05c000 x1875735413497344/t0(0) o103->MGC192.168.204.107@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788841256 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841240.581423:0:3651:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa04b6e05ed80 x1875735413497088/t0(0) o103->MGC192.168.204.107@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788841256 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841240.581432:0:3651:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa04b6e05c380 x1875735413497216/t0(0) o103->MGC192.168.204.107@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788841256 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841240.581440:0:3651:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa04b7c02ad80 x1875735413497472/t0(0) o103->MGC192.168.204.107@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788841256 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788841240.581536:0:3651:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788841240.581539:0:3651:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788841240.581541:0:3651:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788841240.581608:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6d9e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ab398079-8cf9-457a-bcc0-cfc99d2f260b:3649:1875735413495296:0@lo:400:kworker.0 00000100:00080000:1.0:1788841240.585945:0:3650:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffffa04a48b36800 already not connected (conn 1, was 1): DISCONN 00000100:00080000:1.0:1788841240.586005:0:17202:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788841240.586012:0:17202:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788841240.586041:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c02ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ab398079-8cf9-457a-bcc0-cfc99d2f260b:3650:1875735413497472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788841240.586053:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ab398079-8cf9-457a-bcc0-cfc99d2f260b:3650:1875735413497344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788841240.586058:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c02b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ab398079-8cf9-457a-bcc0-cfc99d2f260b:3650:1875735413496960:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788841240.587887:0:3651:0:(import.c:65:import_set_state_nolock()) ffffa04a48b36800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788841240.587898:0:3651:0:(import.c:510:import_select_connection()) MGC192.168.204.107@tcp: connect to NID 0@lo last attempt 572 00000100:00080000:0.0:1788841240.587908:0:3651:0:(import.c:624:import_select_connection()) MGC192.168.204.107@tcp: import ffffa04a48b36800 using connection 192.168.204.107@tcp/0@lo 00000100:00100000:2.0:1788841240.587997:0:3651:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa04a47b44e00 x1875735413497856/t0(0) o250->MGC192.168.204.107@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788841240.588044:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ab398079-8cf9-457a-bcc0-cfc99d2f260b:3651:1875735413497088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788841240.588062:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ab398079-8cf9-457a-bcc0-cfc99d2f260b:3651:1875735413497216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788841240.589029:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ab398079-8cf9-457a-bcc0-cfc99d2f260b:3648:1875735413497856:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:0.0:1788841240.589087:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875735413497856 offset 0 length 520: 4 00000020:00080000:3.0:1788841240.601412:0:20980:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffffa04b527d19b8) has no exports 00000020:01000000:2.0:1788841240.671550:0:20980:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa04b76045ea0 - data ffffa04b7082b0d8/ffffa04b7cb79c00 00000020:01000000:2.0:1788841240.671957:0:20980:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa04b7c707240 - data ffffa04b70969bd0/ffffa04b67909000 00000001:00000004:2.0:1788841240.686957:0:20980:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:0.0:1788841240.739650:0:20980:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788841240.739659:0:20980:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788841240.739667:0:20980:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788841240.741512:0:20980:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788841240.741519:0:20980:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:0.0:1788841240.741538:0:20980:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788841240.741541:0:20980:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788841240.742010:0:17948:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788841240.742015:0:17948:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:2.0:1788841240.742025:0:17948:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:0.0:1788841240.742539:0:20980:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788841240.742544:0:20980:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:0.0:1788841240.742561:0:20980:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788841240.742563:0:20980:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788841240.743361:0:17950:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788841240.743366:0:17950:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:3.0:1788841240.743376:0:17950:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:3.0:1788841240.744443:0:20980:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac3786a 00000020:00000080:3.0:1788841240.744452:0:20980:0:(genops.c:885:class_export_put()) final put ffffa04b7f865000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788841240.745132:0:20980:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac3787f 00000020:00000080:3.0:1788841240.745138:0:20980:0:(genops.c:885:class_export_put()) final put ffffa04b453af800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788841240.745143:0:20980:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1788841240.745148:0:20980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788841240.745158:0:20980:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788841240.745162:0:20980:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffffa04b81afcd28) has no exports 00000004:01000000:3.0:1788841240.745311:0:20980:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788841240.745319:0:20980:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac378d3 00000020:00000080:3.0:1788841240.745323:0:20980:0:(genops.c:885:class_export_put()) final put ffffa04b55856000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788841240.745328:0:20980:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788841240.745331:0:20980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788841240.745336:0:20980:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788841240.745339:0:20980:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffffa04b46de99b8) has no exports 00000020:00000080:3.0:1788841240.745343:0:20980:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac378cc 00000020:00000080:3.0:1788841240.745346:0:20980:0:(genops.c:885:class_export_put()) final put ffffa04b6dc65000/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1788841240.745701:0:20980:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1788841240.745705:0:20980:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788841240.745709:0:20980:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1788841240.745715:0:20980:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788841240.745717:0:20980:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788841240.745742:0:20980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788841240.745749:0:20980:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788841240.745764:0:20980:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac378be 00000020:00000080:3.0:1788841240.745768:0:20980:0:(genops.c:885:class_export_put()) final put ffffa04a47d05800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788841240.745773:0:20980:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788841240.745775:0:20980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788841240.745779:0:20980:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788841240.745781:0:20980:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffffa04b7f778000) has no exports 00000020:00000080:3.0:1788841240.745785:0:20980:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac378b7 00000020:00000080:3.0:1788841240.745788:0:20980:0:(genops.c:885:class_export_put()) final put ffffa04b6dc62800/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1788841240.746151:0:20980:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1788841240.746155:0:20980:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788841240.746157:0:20980:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1788841240.746161:0:20980:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788841240.746162:0:20980:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788841240.746184:0:20980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788841240.746189:0:20980:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1788841240.746199:0:20980:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788841240.746204:0:20980:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac378a2 00000020:00000080:3.0:1788841240.746208:0:20980:0:(genops.c:885:class_export_put()) final put ffffa04b6dc67800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788841240.746212:0:20980:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1788841240.746215:0:20980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788841240.746219:0:20980:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788841240.746221:0:20980:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffffa04b7f77cd28) has no exports 00000020:00000080:3.0:1788841240.746225:0:20980:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac3789b 00000020:00000080:3.0:1788841240.746228:0:20980:0:(genops.c:885:class_export_put()) final put ffffa04b6dfd5000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788841240.747455:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b7f865000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788841240.747470:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b453af800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:2.0:1788841240.747475:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b55856000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1788841240.747481:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b6dc65000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788841240.747487:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa04b6dfd7000 for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1788841240.747505:0:36:0:(genops.c:885:class_export_put()) final put ffffa04a47d03000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788841240.747508:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa04a47d03000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:2.0:1788841240.747513:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788841240.747606:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa04a47d05800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1788841240.747611:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b6dc62800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788841240.747615:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa04b50d1b800 for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1788841240.747618:0:36:0:(genops.c:885:class_export_put()) final put ffffa04b6dfd4000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788841240.747619:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b6dfd4000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:2.0:1788841240.747623:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788841240.747646:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b6dc67800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1788841240.747651:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b6dfd5000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1788841240.747883:0:20980:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1788841240.747887:0:20980:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788841240.747890:0:20980:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788841240.747896:0:20980:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788841240.747965:0:20980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788841240.747976:0:20980:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788841240.748002:0:20980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788841240.748006:0:20980:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788841240.748009:0:20980:0:(genops.c:885:class_export_put()) final put ffffa04b7f867800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788841240.748011:0:20980:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b7f867800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1788841240.748015:0:20980:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788841240.748179:0:20980:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac37886 00000020:00000080:2.0:1788841240.748186:0:20980:0:(genops.c:885:class_export_put()) final put ffffa04b453a9000/lustre-MDD0001_UUID 00000020:01000000:2.0:1788841240.748191:0:20980:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1788841240.748195:0:20980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788841240.748200:0:20980:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788841240.748204:0:20980:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffffa04b527d3370) has no exports 00000020:00000080:2.0:1788841240.748236:0:20980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788841240.748240:0:20980:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:2.0:1788841240.748244:0:20980:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac3788d 00000020:00000080:2.0:1788841240.748248:0:20980:0:(genops.c:885:class_export_put()) final put ffffa04b453aa800/lustre-MDT0001-osd_UUID 00000020:01000004:2.0:1788841240.748258:0:20980:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa04b7cea6800 from lustre-MDT0001, refs=2 00000020:01000004:2.0:1788841240.748262:0:20980:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa04b7cea6800 2 00000020:01000004:2.0:1788841240.748264:0:20980:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffffa04b7cea6800 from lustre-MDT0001 00000020:00000080:2.0:1788841240.748282:0:20980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788841240.748285:0:20980:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:2.0:1788841240.748287:0:20980:0:(genops.c:885:class_export_put()) final put ffffa04b7f862800/lustre-MDT0001_UUID 00000020:00000080:2.0:1788841240.748289:0:20980:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b7f862800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:2.0:1788841240.748296:0:20980:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:2.0:1788841240.748326:0:20980:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:2.0:1788841240.748330:0:20980:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:2.0:1788841240.748333:0:20980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788841240.748336:0:20980:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788841240.748342:0:20980:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffffa04b7f864000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788841240.748347:0:20980:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffffa04b527d0000) has exports, disconnecting them 00000020:00080000:2.0:1788841240.748351:0:20980:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffffa04b7f864000), last request at 1788841154 00000020:00000080:2.0:1788841240.748354:0:20980:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac3790b 00000020:00080000:2.0:1788841240.748367:0:20980:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa04b7f864000): rc 0 00000020:00000080:2.0:1788841240.748371:0:20980:0:(genops.c:885:class_export_put()) final put ffffa04b7f864000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1788841240.749200:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa04b6dfd6000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1788841240.749211:0:36:0:(genops.c:885:class_export_put()) final put ffffa04b6dc66000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788841240.749213:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b6dc66000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:0.0:1788841240.749219:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788841240.749311:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b453a9000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:0.0:1788841240.749316:0:36:0:(genops.c:885:class_export_put()) final put ffffa04b7f860000/lustre-MDD0001_UUID 00000020:00000080:0.0:1788841240.749318:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b7f860000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:0.0:1788841240.749322:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:0.0:1788841240.750182:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b453aa800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788841240.750201:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b7f864000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1788841240.772345:0:20980:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1788841240.772357:0:20980:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788841240.772364:0:20980:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788841240.772373:0:20980:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788841240.772857:0:20980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788841240.772867:0:20980:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1788841240.772874:0:20980:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa04b7cea6800 1 00000020:00000080:3.0:1788841240.772882:0:20980:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac37832 00000020:00000080:3.0:1788841240.772902:0:20980:0:(genops.c:885:class_export_put()) final put ffffa04b43014000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788841240.773071:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa04b7f866000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1788841240.773079:0:36:0:(genops.c:885:class_export_put()) final put ffffa04b7f860800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:0.0:1788841240.773082:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b7f860800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:0.0:1788841240.773094:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000000:3.0:1788841240.773207:0:20980:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1788841240.773211:0:20980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788841240.773217:0:20980:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788841240.773221:0:20980:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffffa04b46deb370) has no exports 00000020:00000080:0.0:1788841240.773507:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b43014000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788841240.833221:0:20980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788841240.833241:0:20980:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1788841240.833247:0:20980:0:(genops.c:885:class_export_put()) final put ffffa04b7cea1800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788841240.833253:0:20980:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b7cea1800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1788841240.833263:0:20980:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1788841240.833438:0:20980:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffffa04b7cea1000 00000020:01000000:3.0:1788841240.833460:0:20980:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1788841240.833463:0:20980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788841240.833467:0:20980:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788841240.833472:0:20980:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffffa04b81af8000) has no exports 00000100:00100000:1.0:1788841240.833664:0:17208:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffffa04b50dd9200:17208] 2 exiting: rc = 0 00000100:00100000:0.0:1788841240.833664:0:17206:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffffa04b7f857c00:17206] 0 exiting: rc = 1 00000100:00100000:0.0:1788841240.833800:0:17207:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffffa04b7fb03200:17207] 1 exiting: rc = 0 00000100:00100000:2.0:1788841240.833902:0:20345:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffffa04a469a6a00:20345] 3 exiting: rc = 0 00000100:00100000:3.0:1788841240.833998:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834005:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834012:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834017:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834023:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834028:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834034:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834040:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834045:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834051:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834056:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834061:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834066:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834071:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834076:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834082:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834088:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834094:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834100:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834119:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834125:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834131:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834136:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834141:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834147:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834152:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834157:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834162:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834168:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834174:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834179:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834185:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834190:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834194:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834199:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834203:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834209:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834218:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834223:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834228:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834234:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834238:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834244:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834250:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834255:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834260:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834266:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834271:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834276:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834281:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834287:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834293:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834299:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834304:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834316:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834322:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834328:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834333:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834339:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834344:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834350:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834355:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834360:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.834366:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841240.837491:0:17210:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffffa04b71171000:17210] 1 exiting: rc = 0 00000100:00100000:2.0:1788841240.837634:0:17209:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffffa04b71170c00:17209] 0 exiting: rc = 1 00000100:00100000:3.0:1788841240.837753:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.837762:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.837768:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.837774:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.837779:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.837784:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.837790:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.837795:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.837800:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.837804:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.837809:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.837814:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.837818:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.837823:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.837828:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.838076:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.838082:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.838088:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.838093:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.838097:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.838103:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.838108:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.838113:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.838118:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.838125:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.838144:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.838149:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.838155:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.838160:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.838165:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.838171:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.838176:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.838182:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.838186:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.838191:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.838196:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.838202:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.838207:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.838212:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.838218:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.838223:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.838227:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.838232:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.838237:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.838241:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.838246:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.838251:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.838256:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.838261:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.838266:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.838272:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.838277:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.838282:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.838287:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.838291:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.838295:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.838300:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.838305:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.838310:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.838314:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.838328:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.838333:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.838338:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.838344:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.838801:0:18209:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffffa04b46e15000:18209] 2 exiting: rc = 0 00000100:00100000:1.0:1788841240.838853:0:17212:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffffa04b7fe2d200:17212] 1 exiting: rc = 0 00000100:00100000:0.0:1788841240.839115:0:17211:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffffa04b7fe2c600:17211] 0 exiting: rc = 1 00000100:00100000:3.0:1788841240.840462:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840471:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840477:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840482:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840489:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840495:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840511:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840518:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840525:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840531:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840538:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840544:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840550:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840556:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840563:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840569:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840575:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840581:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840605:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840613:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840619:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840625:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840631:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840637:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840643:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840649:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840655:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840662:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840668:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840674:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840708:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840717:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840723:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840730:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840737:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840744:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840751:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840759:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840767:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840774:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840782:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840788:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840813:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840822:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840829:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840878:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840885:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840892:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840899:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840906:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840914:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840921:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840929:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840936:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840974:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840983:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840990:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.840997:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.841004:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.841012:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.841019:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.841027:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.841034:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.841043:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788841240.851161:0:17213:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffffa04b7fe2c200:17213] 0 exiting: rc = 1 00000100:00100000:1.0:1788841240.851304:0:17214:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffffa04b41284800:17214] 1 exiting: rc = 0 00000100:00100000:2.0:1788841240.851425:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.851437:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.851448:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.851465:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.851476:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.851487:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.851496:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.851515:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.851526:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.851536:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.851546:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.851555:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.851566:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.851576:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.851587:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.851598:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.851609:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.851618:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.851628:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.851638:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.851649:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.851659:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.851668:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.851678:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.851688:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.851698:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.851709:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.851719:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.851729:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.851738:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.851747:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.851756:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.851765:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.851774:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.851784:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.851795:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.851805:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.851814:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.851823:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.851863:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.851873:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.851880:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.851896:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.851904:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.851913:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.851922:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.851930:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.851940:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.851959:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.851969:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.851978:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.851987:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.851996:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.852005:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.852015:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.852026:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.852036:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.852045:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.852051:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.852061:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.852068:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.852077:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.852082:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.852087:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.852671:0:17216:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffffa04b7f716c00:17216] 1 exiting: rc = 0 00000100:00100000:1.0:1788841240.852794:0:17215:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffffa04b7f717c00:17215] 0 exiting: rc = 1 00000100:00100000:2.0:1788841240.853090:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853097:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853102:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853107:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853112:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853118:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853123:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853129:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853134:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853140:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853144:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853149:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853164:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853168:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853173:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853179:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853185:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853190:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853195:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853201:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853206:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853211:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853216:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853221:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853227:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853231:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853236:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853240:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853245:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853250:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853255:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853260:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853264:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853269:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853274:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853279:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853283:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853289:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853295:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853301:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853306:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853310:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853315:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853321:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853326:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853330:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853336:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853348:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853353:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853357:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853362:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853367:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853372:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853377:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853381:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853386:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853391:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853396:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853401:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853406:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853410:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853415:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853421:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.853426:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.854221:0:17217:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffffa04b7607e600:17217] 0 exiting: rc = 1 00000100:00100000:0.0:1788841240.854325:0:17218:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffffa04b7607e200:17218] 1 exiting: rc = 0 00000100:00100000:2.0:1788841240.854430:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.854436:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.854441:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.854446:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.854451:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.854456:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.854461:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.854467:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.854473:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.854479:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.854484:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.854490:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.854539:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.854544:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.854549:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.854554:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.854559:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.854565:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.854577:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.854581:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.854586:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.854591:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.854596:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.854601:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.854606:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.854611:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.854615:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.854620:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.854625:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.854630:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.854635:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.854640:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.854644:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.854649:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.854654:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.854659:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.854664:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.854669:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.854674:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.854679:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.854684:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.854689:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.854694:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.854700:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.854705:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.854711:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.854716:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.854722:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.854727:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.854732:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.854737:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.854798:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.854804:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.854816:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.854821:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.854826:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.855095:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.855102:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.855107:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.855113:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.855118:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.855123:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.855128:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.855133:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841240.855698:0:17219:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffffa04b559caa00:17219] 0 exiting: rc = 1 00000100:00100000:0.0:1788841240.856106:0:17220:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffffa04a46b5a600:17220] 1 exiting: rc = 0 00000100:00100000:0.0:1788841240.856265:0:17221:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffffa04a46b5a200:17221] 2 exiting: rc = 0 00000100:00100000:2.0:1788841240.856447:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.856453:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.856460:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.856473:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.856496:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.856503:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.856509:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.856516:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.856522:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.856528:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.856533:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.856539:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.856546:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.856554:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.856560:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.856567:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.856572:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.856578:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.856584:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.856590:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.856598:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.856604:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.856610:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.856615:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.856632:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.856638:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.856644:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.856650:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.856670:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.856677:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.856683:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.856689:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.856695:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.856701:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.856707:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.856712:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.856718:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.856723:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.856729:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.856734:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.856739:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.856796:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.856803:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.856808:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.856814:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.856819:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.856825:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.857094:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.857102:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.857107:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.857113:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.857119:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.857140:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.857146:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.857152:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.857158:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.857164:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.857170:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.857175:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.857187:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.857193:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.857198:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.857204:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788841240.857209:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788841240.864739:0:20980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788841240.864762:0:20980:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1788841240.864769:0:20980:0:(genops.c:885:class_export_put()) final put ffffa04b43012800/MDS_uuid 00000020:00000080:3.0:1788841240.864773:0:20980:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b43012800/MDS_uuid for MDS 00000020:01000000:3.0:1788841240.864779:0:20980:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1788841240.864970:0:20980:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1788841241.037185:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841242.062156:0:17960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841243.086290:0:17195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788841243.663336:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) ab398079-8cf9-457a-bcc0-cfc99d2f260b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788841243.663347:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) ab398079-8cf9-457a-bcc0-cfc99d2f260b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788841243.663351:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788841243.663354:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788841243.663359:0:37:0:(import.c:65:import_set_state_nolock()) ffffa04a47c7b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788841243.663368:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 672 00000100:00080000:2.0:1788841243.663375:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788841243.663382:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffffa04a47c7b800 using connection 192.168.204.107@tcp/0@lo 00000100:00100000:2.0:1788841243.663424:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa04a47b46a00 x1875735413497984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788841243.663471:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788841243.663475:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788841243.663477:0:37:0:(import.c:65:import_set_state_nolock()) ffffa04a4745b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788841243.663481:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 672 00000100:00080000:2.0:1788841243.663484:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788841243.663487:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffffa04a4745b000 using connection 192.168.204.107@tcp/0@lo 00000100:00100000:2.0:1788841243.663500:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa04a47b46d80 x1875735413498240/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788841243.663720:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47b45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875735413498112:0@lo:400:kworker.0 00000400:00000100:3.0:1788841243.663775:0:3651:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875735413498112 offset 0 length 224: 4 00000100:00100000:3.0:1788841243.663812:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788841243.663818:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47b47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875735413498368:0@lo:400:kworker.0 00000400:00000100:3.0:1788841243.663862:0:3651:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875735413498368 offset 0 length 224: 4 00000100:00100000:3.0:1788841243.663888:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1875735413497984:0@lo:38:kworker.0 00000400:00000100:3.0:1788841243.663922:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875735413497984 offset 0 length 520: 4 00000100:00100000:3.0:1788841243.663934:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47b46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1875735413498240:0@lo:38:kworker.0 00000400:00000100:3.0:1788841243.663947:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875735413498240 offset 0 length 520: 4 00010000:00010000:0.0:1788841244.109960:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788841244.580200:0:21181:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788841244.594299:0:21181:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788841244.594351:0:21181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c5200/0x5757cd208ac379a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac379ac expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841244.594365:0:21181:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c5200/0x5757cd208ac379a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5757cd208ac379ac expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841244.594373:0:21181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c5200/0x5757cd208ac379a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5757cd208ac379ac expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841244.594381:0:21181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c5200/0x5757cd208ac379a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5757cd208ac379ac expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841244.594422:0:21181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788841244.594435:0:21181:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788841244.594461:0:21181:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788841244.594474:0:21181:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa04a47b46a00 x1875735413497984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788841258 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841244.594491:0:21181:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788841244.594531:0:3648:0:(import.c:65:import_set_state_nolock()) ffffa04a47c7b800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788841244.594536:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:3.0:1788841244.594540:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1875735413497984:0@lo:38:kworker.0 00000100:00080000:3.0:1788841244.594730:0:21181:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788841244.594734:0:21181:0:(import.c:65:import_set_state_nolock()) ffffa04a47c7b800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1788841244.594740:0:21181:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788841244.594742:0:21181:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788841244.594745:0:21181:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788841244.594782:0:17960:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788841244.594793:0:17960:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c5200/0x5757cd208ac379a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x5757cd208ac379ac expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841244.594809:0:17960:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b7f8c5200 already unused, calling callback (ffffffffc11a4c20) 10000000:00010000:2.0:1788841244.594814:0:17960:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c5200/0x5757cd208ac379a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x5757cd208ac379ac expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841244.594824:0:17960:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c5200/0x5757cd208ac379a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x5757cd208ac379ac expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788841244.594861:0:17960:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c5200/0x5757cd208ac379a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x5757cd208ac379ac expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788841244.594869:0:17960:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788841244.594883:0:17960:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788841244.594886:0:17960:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788841244.595095:0:17960:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa04a48b36800 00010000:00010000:2.0:1788841244.595101:0:17960:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c5200/0x5757cd208ac379a5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x5757cd208ac379ac expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841244.595109:0:17960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c5200/0x5757cd208ac379a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x5757cd208ac379ac expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841244.595122:0:17960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841244.595124:0:17960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841244.595126:0:17960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788841244.595706:0:21181:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788841244.595715:0:21181:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa04a47b45880 x1875735413498112/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841259 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841244.595738:0:21181:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788841244.595742:0:21181:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1788841244.595805:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47b45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875735413498112:0@lo:400:kworker.0 00000100:00080000:3.0:1788841244.596125:0:21181:0:(import.c:65:import_set_state_nolock()) ffffa04a45ff4800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788841244.596174:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3648:1875735413498496:0@lo:39:umount.0 00000400:00000100:3.0:1788841244.596223:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875735413498496 offset 0 length 224: 4 00010000:00010000:2.0:1788841245.133069:0:17195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788841245.712428:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) ab398079-8cf9-457a-bcc0-cfc99d2f260b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788841245.712441:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) ab398079-8cf9-457a-bcc0-cfc99d2f260b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788841245.712445:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788841245.712448:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788841245.712540:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6d9e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1875735413498624:0@lo:400:kworker.0 00000400:00000100:3.0:1788841245.712602:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875735413498624 offset 0 length 224: 4 00010000:00010000:0.0:1788841246.157177:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788841246.736013:0:18711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788841246.736023:0:18711:0:(genops.c:885:class_export_put()) final put ffffa04b7f6ff000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788841246.736098:0:11140:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b7f6ff000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788841246.736171:0:11140:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa04b7f6fb000 for lustre-OST0000 00000001:00100000:2.0:1788841246.736534:0:19528:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788841246.736539:0:19528:0:(genops.c:885:class_export_put()) final put ffffa04a4745e000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788841246.736608:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa04a4745e000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788841246.736820:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa04a4745b800 for lustre-OST0001 00010000:00010000:2.0:1788841247.185366:0:17960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841248.205088:0:17195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788841248.717083:0:11140:0:(pinger.c:229:ptlrpc_pinger_process_import()) ab398079-8cf9-457a-bcc0-cfc99d2f260b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788841248.717092:0:11140:0:(pinger.c:247:ptlrpc_pinger_process_import()) ab398079-8cf9-457a-bcc0-cfc99d2f260b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788841248.717095:0:11140:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788841248.717098:0:11140:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788841248.717227:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788841248.717244:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1875735413498752:0@lo:400:kworker.0 00000400:00000100:0.0:1788841248.717309:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875735413498752 offset 0 length 224: 4 00010000:00010000:0.0:1788841249.229419:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841250.260952:0:17960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841250.765110:0:3648:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788841240/real 1788841240] req@ffffa04a47b44e00 x1875735413497856/t0(0) o250->MGC192.168.204.107@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788841250 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841250.765145:0:3648:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa04a47b44e00 x1875735413497856/t0(0) o250->MGC192.168.204.107@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788841250 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788841250.765165:0:3648:0:(import.c:65:import_set_state_nolock()) ffffa04a48b36800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788841250.765190:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1788841250.765194:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ab398079-8cf9-457a-bcc0-cfc99d2f260b:3648:1875735413497856:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:2.0:1788841250.765406:0:11140:0:(pinger.c:229:ptlrpc_pinger_process_import()) ab398079-8cf9-457a-bcc0-cfc99d2f260b->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788841250.765411:0:11140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788841250.765415:0:11140:0:(import.c:65:import_set_state_nolock()) ffffa04a48b36800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788841250.765419:0:11140:0:(import.c:510:import_select_connection()) MGC192.168.204.107@tcp: connect to NID 0@lo last attempt 674 00000100:00080000:2.0:1788841250.765424:0:11140:0:(import.c:589:import_select_connection()) MGC192.168.204.107@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788841250.765431:0:11140:0:(import.c:624:import_select_connection()) MGC192.168.204.107@tcp: import ffffa04a48b36800 using connection 192.168.204.107@tcp/0@lo 00000100:00100000:2.0:1788841250.765467:0:11140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa04a47b45880 x1875735413498880/t0(0) o250->MGC192.168.204.107@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788841250.765487:0:11140:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788841250.765491:0:11140:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788841250.765607:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875735413499008:0@lo:400:kworker.0 00000400:00000100:0.0:1788841250.765657:0:3651:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875735413499008 offset 0 length 224: 4 00000100:00100000:3.0:1788841250.766024:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47b45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ab398079-8cf9-457a-bcc0-cfc99d2f260b:3648:1875735413498880:0@lo:250:kworker.0 00000400:00000100:3.0:1788841250.766054:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875735413498880 offset 0 length 520: 4 00010000:00010000:2.0:1788841251.279645:0:17195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841252.301772:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841253.327430:0:17960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841254.351020:0:17195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841254.861021:0:3648:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788841244/real 1788841244] req@ffffa04b6e05f100 x1875735413498496/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788841254 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841254.861059:0:3648:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa04b6e05f100 x1875735413498496/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788841254 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788841254.861084:0:3648:0:(import.c:65:import_set_state_nolock()) ffffa04a45ff4800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788841254.861103:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3648:1875735413498496:0@lo:39:umount.0 00000100:00080000:2.0:1788841254.861143:0:21181:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788841254.861148:0:21181:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788841254.861153:0:21181:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788841254.862046:0:21181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b81b5d400/0x5757cd208ac3797b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac37982 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841254.862061:0:21181:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b81b5d400/0x5757cd208ac3797b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5757cd208ac37982 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841254.862067:0:21181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b81b5d400/0x5757cd208ac3797b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5757cd208ac37982 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841254.862074:0:21181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.107@tcp lock: ffffa04b81b5d400/0x5757cd208ac3797b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5757cd208ac37982 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841254.862213:0:21181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788841254.862223:0:21181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b67bb2800/0x5757cd208ac37cd1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac37cd8 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841254.862230:0:21181:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b67bb2800/0x5757cd208ac37cd1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5757cd208ac37cd8 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841254.862237:0:21181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b67bb2800/0x5757cd208ac37cd1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5757cd208ac37cd8 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841254.862242:0:21181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.107@tcp lock: ffffa04b67bb2800/0x5757cd208ac37cd1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5757cd208ac37cd8 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841254.862361:0:17194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788841254.862369:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.107@tcp lock: ffffa04b81b5d400/0x5757cd208ac3797b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5757cd208ac37982 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841254.862377:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b81b5d400 already unused, calling callback (ffffffffc11a4c20) 10000000:00010000:0.0:1788841254.862381:0:17194:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.107@tcp lock: ffffa04b81b5d400/0x5757cd208ac3797b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5757cd208ac37982 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841254.862391:0:17194:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.107@tcp lock: ffffa04b81b5d400/0x5757cd208ac3797b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x5757cd208ac37982 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788841254.862538:0:17194:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.107@tcp lock: ffffa04b81b5d400/0x5757cd208ac3797b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x5757cd208ac37982 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788841254.862544:0:17194:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788841254.862547:0:17194:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:0.0:1788841254.862559:0:17194:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa04a48b36800 00010000:00010000:0.0:1788841254.862563:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.107@tcp lock: ffffa04b81b5d400/0x5757cd208ac3797b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x5757cd208ac37982 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841254.862568:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.107@tcp lock: ffffa04b81b5d400/0x5757cd208ac3797b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x5757cd208ac37982 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841254.862583:0:17194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788841254.862586:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.107@tcp lock: ffffa04b67bb2800/0x5757cd208ac37cd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5757cd208ac37cd8 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841254.862592:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b67bb2800 already unused, calling callback (ffffffffc11a4c20) 10000000:00010000:0.0:1788841254.862594:0:17194:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.107@tcp lock: ffffa04b67bb2800/0x5757cd208ac37cd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5757cd208ac37cd8 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841254.863124:0:21181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 10000000:01000000:2.0:1788841254.863132:0:21181:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:2.0:1788841254.863137:0:21181:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1788841254.863163:0:21181:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1788841254.863167:0:21181:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1788841254.863173:0:21181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788841254.863179:0:21181:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788841254.863183:0:21181:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffffa04b5c84cd28) has no exports 00000020:00080000:2.0:1788841254.863208:0:21181:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffffa04b5c84cd28) has no exports 00010000:00010000:0.0:1788841254.863768:0:17194:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.107@tcp lock: ffffa04b67bb2800/0x5757cd208ac37cd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5757cd208ac37cd8 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788841254.863776:0:17194:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.107@tcp lock: ffffa04b67bb2800/0x5757cd208ac37cd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5757cd208ac37cd8 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788841254.863782:0:17194:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788841254.863784:0:17194:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788841254.863787:0:17194:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788841254.863796:0:17194:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa04a48b36800 00010000:00010000:0.0:1788841254.863799:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.107@tcp lock: ffffa04b67bb2800/0x5757cd208ac37cd1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5757cd208ac37cd8 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841254.863806:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.107@tcp lock: ffffa04b67bb2800/0x5757cd208ac37cd1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5757cd208ac37cd8 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841254.863818:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841254.863820:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788841254.865177:0:21181:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa04a47bf0c60 - data ffffa04b709dbe58/ffffa04b7cb74400 00000020:01000000:2.0:1788841254.865335:0:21181:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa04a47bf0a20 - data ffffa04b70b570d8/ffffa04a47476800 00010000:00010000:1.0:1788841254.866146:0:17960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841254.866200:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1788841254.882965:0:21181:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788841254.901480:0:21181:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac37990 00000020:00000080:2.0:1788841254.901493:0:21181:0:(genops.c:885:class_export_put()) final put ffffa04b7f6fc000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788841254.901519:0:21181:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa04b7d09c800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788841254.901524:0:21181:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa04b7d09c800 2 00000020:01000004:2.0:1788841254.901539:0:21181:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffffa04b7d09c800 from lustre-OST0000 00000020:00000080:2.0:1788841254.901560:0:21181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788841254.901571:0:21181:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788841254.901575:0:21181:0:(genops.c:885:class_export_put()) final put ffffa04a45ff3000/lustre-OST0000_UUID 00000020:00000080:2.0:1788841254.901578:0:21181:0:(genops.c:844:class_export_destroy()) destroying export ffffa04a45ff3000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788841254.901584:0:21181:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788841254.901642:0:21181:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788841254.901647:0:21181:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788841254.901650:0:21181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788841254.901656:0:21181:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788841254.901662:0:21181:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffffa04a47c7d800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788841254.901668:0:21181:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffffa04b7f77b370) has exports, disconnecting them 00000020:00080000:2.0:1788841254.901690:0:21181:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffffa04a47c7d800), last request at 1788841170 00000020:00000080:2.0:1788841254.901695:0:21181:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac379ba 00000020:00080000:2.0:1788841254.901706:0:21181:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa04a47c7d800): rc 0 00000020:00000080:2.0:1788841254.901710:0:21181:0:(genops.c:885:class_export_put()) final put ffffa04a47c7d800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788841254.902444:0:11140:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b7f6fc000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788841254.902461:0:11140:0:(genops.c:844:class_export_destroy()) destroying export ffffa04a47c7d800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788841254.907927:0:21181:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788841254.907937:0:21181:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788841254.907941:0:21181:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788841254.907949:0:21181:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788841254.908160:0:21181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788841254.908169:0:21181:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1788841254.908175:0:21181:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788841254.908183:0:21181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788841254.908197:0:21181:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788841254.908205:0:21181:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffffa04a45ff6800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788841254.908211:0:21181:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffffa04b6e0cb370) has exports, disconnecting them 00000020:00080000:0.0:1788841254.908217:0:21181:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffffa04a45ff6800), last request at 1788841170 00000020:00000080:0.0:1788841254.908221:0:21181:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac379cf 00000020:00080000:0.0:1788841254.908239:0:21181:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa04a45ff6800): rc 0 00000020:00000080:0.0:1788841254.908244:0:21181:0:(genops.c:885:class_export_put()) final put ffffa04a45ff6800/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788841254.908948:0:11140:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa04a47c7b800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788841254.908958:0:11140:0:(genops.c:885:class_export_put()) final put ffffa04a47c7f000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788841254.908961:0:11140:0:(genops.c:844:class_export_destroy()) destroying export ffffa04a47c7f000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788841254.908976:0:11140:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1788841254.909043:0:11140:0:(genops.c:844:class_export_destroy()) destroying export ffffa04a45ff6800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1788841254.909081:0:21181:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788841254.909086:0:21181:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788841254.909089:0:21181:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788841254.909094:0:21181:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788841254.909111:0:11140:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa04a45ff4800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788841254.909265:0:21181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788841254.909273:0:21181:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1788841254.909276:0:21181:0:(genops.c:885:class_export_put()) final put ffffa04b7f42c800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1788841254.909279:0:21181:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b7f42c800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1788841254.909283:0:21181:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1788841254.909310:0:21181:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa04b7d09c800 1 00000020:00000080:1.0:1788841254.909321:0:21181:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac3796d 00000020:00000080:1.0:1788841254.909327:0:21181:0:(genops.c:885:class_export_put()) final put ffffa04b7f861800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788841254.909334:0:21181:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788841254.909342:0:11140:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b7f861800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788841254.909351:0:21181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788841254.909355:0:21181:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788841254.909358:0:21181:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffffa04b5c848000) has no exports 00000020:00000080:1.0:1788841254.970099:0:21181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788841254.970116:0:21181:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788841254.970122:0:21181:0:(genops.c:885:class_export_put()) final put ffffa04b7d09f000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788841254.970127:0:21181:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b7d09f000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788841254.970138:0:21181:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788841254.970253:0:21181:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffffa04b7d09e800 00000020:02000400:1.0:1788841254.970301:0:21181:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1788841255.382604:0:17195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788841255.948920:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) ab398079-8cf9-457a-bcc0-cfc99d2f260b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788841255.948929:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) ab398079-8cf9-457a-bcc0-cfc99d2f260b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788841255.948932:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788841255.948935:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788841255.949054:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47b47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1875735413499136:0@lo:400:kworker.0 00000400:00000100:1.0:1788841255.949115:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875735413499136 offset 0 length 224: 4 00010000:00010000:1.0:1788841256.397369:0:17960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841257.427342:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841258.445043:0:17195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841258.956989:0:3648:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788841243/real 1788841243] req@ffffa04a47b46d80 x1875735413498240/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788841258 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841258.957023:0:3648:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa04a47b46d80 x1875735413498240/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788841258 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788841258.957045:0:3648:0:(import.c:65:import_set_state_nolock()) ffffa04a4745b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788841258.957425:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788841258.957431:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47b46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1875735413498240:0@lo:38:kworker.0 00000100:00080000:0.0:1788841258.958063:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) ab398079-8cf9-457a-bcc0-cfc99d2f260b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788841258.958070:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) ab398079-8cf9-457a-bcc0-cfc99d2f260b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788841258.958073:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788841258.958077:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788841258.958152:0:37:0:(import.c:65:import_set_state_nolock()) ffffa04a4745b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788841258.958160:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 677 00000100:00080000:0.0:1788841258.958165:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788841258.958172:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffffa04a4745b000 using connection 192.168.204.107@tcp/0@lo 00000100:00100000:0.0:1788841258.958213:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa04b7c029f80 x1875735413499264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788841258.958280:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788841258.958406:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c02a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1875735413499392:0@lo:400:kworker.0 00000400:00000100:0.0:1788841258.958468:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875735413499392 offset 0 length 224: 4 00000100:00100000:3.0:1788841258.958696:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c029f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1875735413499264:0@lo:38:kworker.0 00000400:00000100:3.0:1788841258.958722:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875735413499264 offset 0 length 520: 4 00000020:01000004:1.0:1788841259.184252:0:21384:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788841259.203133:0:21384:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1788841259.203293:0:21384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04a47e43200/0x5757cd208ac37b03 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac37b0a expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841259.203310:0:21384:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04a47e43200/0x5757cd208ac37b03 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5757cd208ac37b0a expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841259.203318:0:21384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04a47e43200/0x5757cd208ac37b03 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5757cd208ac37b0a expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841259.203326:0:21384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.107@tcp lock: ffffa04a47e43200/0x5757cd208ac37b03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5757cd208ac37b0a expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841259.203364:0:21384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788841259.203370:0:21384:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788841259.203393:0:21384:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788841259.203405:0:21384:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa04b7c029f80 x1875735413499264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788841278 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788841259.203410:0:17960:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788841259.203418:0:17960:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.107@tcp lock: ffffa04a47e43200/0x5757cd208ac37b03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5757cd208ac37b0a expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841259.203436:0:17960:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a47e43200 already unused, calling callback (ffffffffc11a4c20) 10000000:00010000:0.0:1788841259.203440:0:17960:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.107@tcp lock: ffffa04a47e43200/0x5757cd208ac37b03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5757cd208ac37b0a expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841259.203449:0:17960:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.107@tcp lock: ffffa04a47e43200/0x5757cd208ac37b03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5757cd208ac37b0a expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788841259.203455:0:17960:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.107@tcp lock: ffffa04a47e43200/0x5757cd208ac37b03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5757cd208ac37b0a expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788841259.203461:0:17960:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788841259.203464:0:17960:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 00000100:00100000:1.0:1788841259.203466:0:21384:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 10000000:01000000:0.0:1788841259.203466:0:17960:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00080000:1.0:1788841259.203472:0:21384:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788841259.203478:0:21384:0:(import.c:65:import_set_state_nolock()) ffffa04a4745b000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1788841259.203483:0:21384:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788841259.203486:0:21384:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa04b7c029f80 x1875735413499264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788841278 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788841259.203489:0:17960:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa04a48b36800 00010000:00010000:0.0:1788841259.203493:0:17960:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.107@tcp lock: ffffa04a47e43200/0x5757cd208ac37b03 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5757cd208ac37b0a expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841259.203499:0:17960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.107@tcp lock: ffffa04a47e43200/0x5757cd208ac37b03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5757cd208ac37b0a expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841259.203510:0:17960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841259.203512:0:17960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841259.203514:0:17960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788841259.204887:0:21384:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788841259.204926:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c029f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1875735413499264:0@lo:38:kworker.0 00000100:00100000:1.0:1788841259.204987:0:21384:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1788841259.207339:0:21384:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788841259.207464:0:21384:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa04a47b47480 x1875735413498368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841259 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788841259.207549:0:21384:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa04b6d9e0000 x1875735413498624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841261 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788841259.207567:0:21384:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa04b6e05fb80 x1875735413498752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841264 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788841259.207576:0:21384:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa04a47b44a80 x1875735413499008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841266 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788841259.207584:0:21384:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa04a47b47100 x1875735413499136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841271 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788841259.207723:0:21384:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa04b7c02a680 x1875735413499392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841274 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788841259.207756:0:21384:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788841259.207763:0:21384:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788841259.207787:0:21384:0:(import.c:65:import_set_state_nolock()) ffffa04a47c78800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788841259.207878:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1875735413498752:0@lo:400:kworker.0 00000100:00100000:3.0:1788841259.207887:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6d9e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1875735413498624:0@lo:400:kworker.0 00000100:00100000:3.0:1788841259.207926:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6d9e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3648:1875735413499520:0@lo:39:umount.0 00000400:00000100:3.0:1788841259.207972:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875735413499520 offset 0 length 224: 4 00000100:00100000:1.0:1788841259.208107:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c02a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1875735413499392:0@lo:400:kworker.0 00000100:00100000:2.0:1788841259.208330:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875735413499008:0@lo:400:kworker.0 00000100:00100000:2.0:1788841259.208338:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47b47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875735413498368:0@lo:400:kworker.0 00000100:00100000:0.0:1788841259.208369:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47b47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1875735413499136:0@lo:400:kworker.0 00010000:00010000:0.0:1788841259.470325:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841260.493136:0:17195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841261.517145:0:17960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841262.546525:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841263.565070:0:17195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788841264.140954:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) ab398079-8cf9-457a-bcc0-cfc99d2f260b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788841264.140982:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) ab398079-8cf9-457a-bcc0-cfc99d2f260b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1788841264.589091:0:17960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788841265.357202:0:3648:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788841250/real 1788841250] req@ffffa04a47b45880 x1875735413498880/t0(0) o250->MGC192.168.204.107@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788841265 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841265.357237:0:3648:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa04a47b45880 x1875735413498880/t0(0) o250->MGC192.168.204.107@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788841265 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788841265.357257:0:3648:0:(import.c:65:import_set_state_nolock()) ffffa04a48b36800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788841265.357278:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788841265.357282:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47b45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ab398079-8cf9-457a-bcc0-cfc99d2f260b:3648:1875735413498880:0@lo:250:kworker.0 00000100:00080000:3.0:1788841265.357400:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) ab398079-8cf9-457a-bcc0-cfc99d2f260b->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788841265.357407:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788841265.357410:0:37:0:(import.c:65:import_set_state_nolock()) ffffa04a48b36800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788841265.357415:0:37:0:(import.c:510:import_select_connection()) MGC192.168.204.107@tcp: connect to NID 0@lo last attempt 684 00000100:00080000:3.0:1788841265.357420:0:37:0:(import.c:589:import_select_connection()) MGC192.168.204.107@tcp: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788841265.357427:0:37:0:(import.c:624:import_select_connection()) MGC192.168.204.107@tcp: import ffffa04a48b36800 using connection 192.168.204.107@tcp/0@lo 00000100:00100000:3.0:1788841265.357460:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa04b6e05fb80 x1875735413499648/t0(0) o250->MGC192.168.204.107@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788841265.357695:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ab398079-8cf9-457a-bcc0-cfc99d2f260b:3648:1875735413499648:0@lo:250:kworker.0 00000400:00000100:0.0:1788841265.357744:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875735413499648 offset 0 length 520: 4 00010000:00010000:0.0:1788841265.613027:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841266.636970:0:17195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841267.661065:0:17960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841268.685494:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788841269.452959:0:3648:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788841259/real 1788841259] req@ffffa04b6d9e0e00 x1875735413499520/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788841269 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841269.453008:0:3648:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa04b6d9e0e00 x1875735413499520/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788841269 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788841269.453031:0:3648:0:(import.c:65:import_set_state_nolock()) ffffa04a47c78800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788841269.453052:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6d9e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3648:1875735413499520:0@lo:39:umount.0 00000100:00080000:1.0:1788841269.453208:0:21384:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788841269.453214:0:21384:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788841269.453219:0:21384:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788841269.454957:0:21384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04a47e43800/0x5757cd208ac37ad9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac37ae0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841269.454975:0:21384:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04a47e43800/0x5757cd208ac37ad9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5757cd208ac37ae0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841269.454984:0:21384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04a47e43800/0x5757cd208ac37ad9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5757cd208ac37ae0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841269.455003:0:21384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.107@tcp lock: ffffa04a47e43800/0x5757cd208ac37ad9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5757cd208ac37ae0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841269.455028:0:21384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788841269.455035:0:21384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b67bb2c00/0x5757cd208ac37cc3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac37cca expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841269.455041:0:21384:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b67bb2c00/0x5757cd208ac37cc3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5757cd208ac37cca expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841269.455046:0:21384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b67bb2c00/0x5757cd208ac37cc3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5757cd208ac37cca expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841269.455068:0:21384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.107@tcp lock: ffffa04b67bb2c00/0x5757cd208ac37cc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5757cd208ac37cca expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841269.455077:0:21384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788841269.455081:0:21384:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1788841269.455105:0:21384:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1788841269.455109:0:21384:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1788841269.455114:0:21384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788841269.455120:0:21384:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788841269.455123:0:21384:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffffa04b6e03cd28) has no exports 00000020:00080000:1.0:1788841269.455150:0:21384:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffffa04b6e03cd28) has no exports 00010000:00010000:0.0:1788841269.458985:0:17960:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788841269.459002:0:17960:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.107@tcp lock: ffffa04a47e43800/0x5757cd208ac37ad9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5757cd208ac37ae0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841269.459037:0:17960:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a47e43800 already unused, calling callback (ffffffffc11a4c20) 10000000:00010000:0.0:1788841269.459041:0:17960:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.107@tcp lock: ffffa04a47e43800/0x5757cd208ac37ad9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5757cd208ac37ae0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841269.459051:0:17960:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.107@tcp lock: ffffa04a47e43800/0x5757cd208ac37ad9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5757cd208ac37ae0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788841269.459058:0:17960:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.107@tcp lock: ffffa04a47e43800/0x5757cd208ac37ad9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5757cd208ac37ae0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788841269.459063:0:17960:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788841269.459065:0:17960:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1788841269.459068:0:17960:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1788841269.459086:0:17960:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa04a48b36800 00010000:00010000:0.0:1788841269.459090:0:17960:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.107@tcp lock: ffffa04a47e43800/0x5757cd208ac37ad9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5757cd208ac37ae0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841269.459096:0:17960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.107@tcp lock: ffffa04a47e43800/0x5757cd208ac37ad9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5757cd208ac37ae0 expref: -99 pid: 19527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841269.459113:0:17960:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788841269.459118:0:17960:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.107@tcp lock: ffffa04b67bb2c00/0x5757cd208ac37cc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5757cd208ac37cca expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841269.459124:0:17960:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b67bb2c00 already unused, calling callback (ffffffffc11a4c20) 10000000:00010000:0.0:1788841269.459127:0:17960:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.107@tcp lock: ffffa04b67bb2c00/0x5757cd208ac37cc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5757cd208ac37cca expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841269.459135:0:17960:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.107@tcp lock: ffffa04b67bb2c00/0x5757cd208ac37cc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5757cd208ac37cca expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841269.459149:0:17195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:0.0:1788841269.459150:0:17960:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.107@tcp lock: ffffa04b67bb2c00/0x5757cd208ac37cc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5757cd208ac37cca expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788841269.459157:0:17960:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788841269.459160:0:17960:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788841269.459162:0:17960:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788841269.459181:0:17960:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa04a48b36800 00010000:00010000:0.0:1788841269.459185:0:17960:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.107@tcp lock: ffffa04b67bb2c00/0x5757cd208ac37cc3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5757cd208ac37cca expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841269.459192:0:17960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.107@tcp lock: ffffa04b67bb2c00/0x5757cd208ac37cc3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5757cd208ac37cca expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841269.459207:0:17960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841269.459209:0:17960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841269.459211:0:17960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788841269.471025:0:21384:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa04a47bf0780 - data ffffa04b70824948/ffffa04b7cb74800 00000020:01000000:1.0:1788841269.471151:0:21384:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa04b7f4bad80 - data ffffa04a46016288/ffffa04a41b5a800 00100000:10000000:1.0:1788841269.496114:0:21384:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788841269.508962:0:21384:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac37aee 00000020:00000080:0.0:1788841269.508979:0:21384:0:(genops.c:885:class_export_put()) final put ffffa04a47c79000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1788841269.508995:0:21384:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa04b7f42b800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1788841269.508999:0:21384:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa04b7f42b800 2 00000020:01000004:0.0:1788841269.509002:0:21384:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffffa04b7f42b800 from lustre-OST0001 00000020:00000080:0.0:1788841269.509027:0:21384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788841269.509036:0:21384:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1788841269.509039:0:21384:0:(genops.c:885:class_export_put()) final put ffffa04a47c7e000/lustre-OST0001_UUID 00000020:00000080:0.0:1788841269.509042:0:21384:0:(genops.c:844:class_export_destroy()) destroying export ffffa04a47c7e000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1788841269.509049:0:21384:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1788841269.509148:0:21384:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import ab398079-8cf9-457a-bcc0-cfc99d2f260b->MGS 00000020:00000080:2.0:1788841269.509182:0:11140:0:(genops.c:844:class_export_destroy()) destroying export ffffa04a47c79000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00010000:00010000:0.0:1788841269.509330:0:21384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c5a00/0x5757cd208ac37839 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5757cd208ac37840 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788841269.509356:0:21384:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c5a00/0x5757cd208ac37839 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5757cd208ac37840 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788841269.509362:0:21384:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1788841269.509366:0:21384:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1788841269.509369:0:21384:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1788841269.509383:0:21384:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa04a48b36800 00010000:00010000:0.0:1788841269.509386:0:21384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.107@tcp lock: ffffa04b7f8c5a00/0x5757cd208ac37839 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5757cd208ac37840 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841269.509662:0:21384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.107@tcp lock: ffffa04a47e42800/0x5757cd208ac37728 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5757cd208ac3772f expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788841269.509670:0:21384:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.107@tcp lock: ffffa04a47e42800/0x5757cd208ac37728 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5757cd208ac3772f expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788841269.509681:0:21384:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788841269.509684:0:21384:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788841269.509686:0:21384:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788841269.509696:0:21384:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa04a48b36800 00010000:00010000:2.0:1788841269.509699:0:21384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.107@tcp lock: ffffa04a47e42800/0x5757cd208ac37728 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5757cd208ac3772f expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788841269.509717:0:21384:0:(import.c:65:import_set_state_nolock()) ffffa04a48b36800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788841269.509721:0:21384:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788841269.509723:0:21384:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788841269.509725:0:21384:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788841269.509729:0:21384:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788841269.509739:0:21384:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa04b6e05fb80 x1875735413499648/t0(0) o250->MGC192.168.204.107@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788841285 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788841269.509759:0:21384:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788841269.509761:0:21384:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 21s for inflight to error out 00000100:00100000:0.0:1788841269.510143:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ab398079-8cf9-457a-bcc0-cfc99d2f260b:3648:1875735413499648:0@lo:250:kworker.0 10000000:01000000:2.0:1788841269.510414:0:21384:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788841269.510422:0:21384:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac37713 00000020:00000080:2.0:1788841269.510428:0:21384:0:(genops.c:885:class_export_put()) final put ffffa04b43011000/ab398079-8cf9-457a-bcc0-cfc99d2f260b 00000020:01000000:2.0:1788841269.510446:0:21384:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.107@tcp (flags='') 00000020:00000080:2.0:1788841269.510452:0:21384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788841269.510458:0:21384:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.107@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788841269.510461:0:21384:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffffa04a47c84d28) has no exports 00000020:00000080:3.0:1788841269.510507:0:11140:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b43011000/ab398079-8cf9-457a-bcc0-cfc99d2f260b for MGC192.168.204.107@tcp 10000000:01000000:0.0:1788841269.510588:0:17203:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1788841269.510675:0:21384:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.107@tcp: client import never connected 00000100:00080000:2.0:1788841269.510678:0:21384:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788841269.510680:0:21384:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788841269.510682:0:21384:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788841269.510684:0:21384:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788841269.510725:0:21384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788841269.510730:0:21384:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.107@tcp (uuid ab398079-8cf9-457a-bcc0-cfc99d2f260b) 00000020:01000000:2.0:1788841269.510735:0:21384:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788841269.510744:0:21384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788841269.510748:0:21384:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788841269.510752:0:21384:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffffa04a4745a000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788841269.510758:0:21384:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffffa04b7fa23370) has exports, disconnecting them 00000020:00080000:2.0:1788841269.510762:0:21384:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffffa04a4745a000), last request at 1788841187 00000020:00000080:2.0:1788841269.510765:0:21384:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac37b18 00000020:00080000:2.0:1788841269.510776:0:21384:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa04a4745a000): rc 0 00000020:00000080:2.0:1788841269.510779:0:21384:0:(genops.c:885:class_export_put()) final put ffffa04a4745a000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788841269.511507:0:11140:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa04a48b36800 for MGC192.168.204.107@tcp 00000020:00000080:3.0:1788841269.511515:0:11140:0:(genops.c:885:class_export_put()) final put ffffa04a48b30000/ab398079-8cf9-457a-bcc0-cfc99d2f260b 00000020:00000080:3.0:1788841269.511518:0:11140:0:(genops.c:844:class_export_destroy()) destroying export ffffa04a48b30000/ab398079-8cf9-457a-bcc0-cfc99d2f260b for MGC192.168.204.107@tcp 00000020:01000000:3.0:1788841269.511523:0:11140:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.107@tcp (ab398079-8cf9-457a-bcc0-cfc99d2f260b) 00000020:00000080:3.0:1788841269.511760:0:11140:0:(genops.c:844:class_export_destroy()) destroying export ffffa04a4745a000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788841269.512302:0:21384:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788841269.512307:0:21384:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788841269.512310:0:21384:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788841269.512315:0:21384:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788841269.512466:0:21384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788841269.512474:0:21384:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1788841269.512480:0:21384:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788841269.512484:0:21384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788841269.512487:0:21384:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788841269.512492:0:21384:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffffa04b48484800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788841269.512498:0:21384:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffffa04b6e038000) has exports, disconnecting them 00000020:00080000:2.0:1788841269.512502:0:21384:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffffa04b48484800), last request at 1788841187 00000020:00000080:2.0:1788841269.512506:0:21384:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac37b2d 00000020:00080000:2.0:1788841269.512515:0:21384:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa04b48484800): rc 0 00000020:00000080:2.0:1788841269.512518:0:21384:0:(genops.c:885:class_export_put()) final put ffffa04b48484800/lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1788841269.513068:0:21384:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788841269.513071:0:21384:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788841269.513074:0:21384:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788841269.513077:0:21384:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788841269.513214:0:11140:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa04a4745b000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788841269.513221:0:11140:0:(genops.c:885:class_export_put()) final put ffffa04a47459800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788841269.513223:0:11140:0:(genops.c:844:class_export_destroy()) destroying export ffffa04a47459800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788841269.513227:0:11140:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788841269.513274:0:11140:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b48484800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1788841269.513279:0:11140:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa04a47c78800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:0.0:1788841269.513455:0:17194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1788841269.513692:0:17195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1788841269.513985:0:17960:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1788841269.514180:0:17189:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffffa04b71174800:17189] 0 exiting: rc = 1 00000100:00100000:2.0:1788841269.522869:0:17190:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffffa04b71175200:17190] 1 exiting: rc = 0 00000100:00100000:0.0:1788841269.523326:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.523650:0:17193:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffffa04b7d05de00:17193] 2 exiting: rc = 0 00000100:00100000:3.0:1788841269.523986:0:17191:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffffa04b7d05cc00:17191] 0 exiting: rc = 1 00000100:00100000:3.0:1788841269.524042:0:18363:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffffa04b5ca86000:18363] 3 exiting: rc = 0 00000100:00100000:2.0:1788841269.529461:0:17192:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffffa04b7d05da00:17192] 1 exiting: rc = 0 00000100:00100000:0.0:1788841269.529685:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.529694:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.529700:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.529706:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.529713:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.529720:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.529727:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.529732:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.529738:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.529743:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.529748:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.529754:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.529773:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.529779:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.529783:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.529788:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.529794:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.529800:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.529805:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.529810:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.529815:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.529821:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.529826:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.529862:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.529869:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.529874:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.529880:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.529884:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.529889:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.529894:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.529899:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.529905:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.529910:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.529916:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.529921:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.529927:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.529932:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.529937:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.529943:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.529948:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.529954:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.529961:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.529966:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.529971:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.529977:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.529983:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.529988:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.530001:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.530006:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.530011:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.530015:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.530020:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.530025:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.530030:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.530035:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.530041:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.530046:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.530051:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.530056:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.530061:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.530067:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.530072:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.530078:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.530083:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788841269.538913:0:21384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788841269.538928:0:21384:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:0.0:1788841269.538935:0:21384:0:(genops.c:885:class_export_put()) final put ffffa04a47c7c000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:0.0:1788841269.538939:0:21384:0:(genops.c:844:class_export_destroy()) destroying export ffffa04a47c7c000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:0.0:1788841269.538948:0:21384:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:0.0:1788841269.539021:0:21384:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa04b7f42b800 1 00000020:00000080:0.0:1788841269.539027:0:21384:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5757cd208ac37ad2 00000020:00000080:0.0:1788841269.539033:0:21384:0:(genops.c:885:class_export_put()) final put ffffa04b527e1800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1788841269.539044:0:21384:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1788841269.539048:0:21384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788841269.539052:0:21384:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788841269.539056:0:21384:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffffa04b6e0c99b8) has no exports 00000020:00000080:3.0:1788841269.539425:0:11140:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b527e1800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788841269.578966:0:21384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788841269.578980:0:21384:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1788841269.578985:0:21384:0:(genops.c:885:class_export_put()) final put ffffa04a45ff5800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1788841269.578990:0:21384:0:(genops.c:844:class_export_destroy()) destroying export ffffa04a45ff5800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1788841269.579012:0:21384:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1788841269.579336:0:21384:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffffa04a45ff1800 00000020:01000000:0.0:1788841269.579357:0:21384:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1788841269.579362:0:21384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788841269.579366:0:21384:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788841269.579370:0:21384:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffffa04b527d4d28) has no exports 00000020:00000080:0.0:1788841269.580406:0:21384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788841269.580416:0:21384:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1788841269.580420:0:21384:0:(genops.c:885:class_export_put()) final put ffffa04b7f867000/OSS_uuid 00000020:00000080:0.0:1788841269.580423:0:21384:0:(genops.c:844:class_export_destroy()) destroying export ffffa04b7f867000/OSS_uuid for OSS 00000020:01000000:0.0:1788841269.580428:0:21384:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1788841269.580604:0:19184:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffffa04a47405e00:19184] 3 exiting: rc = 0 00000100:00100000:0.0:1788841269.582030:0:18715:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffffa04b678c6a00:18715] 1 exiting: rc = 0 00000100:00080000:3.0:1788841269.582129:0:17202:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1788841269.582713:0:18716:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffffa04b6e16dc00:18716] 2 exiting: rc = 0 00000100:00100000:0.0:1788841269.583902:0:18714:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffffa04b473e4000:18714] 0 exiting: rc = 1 00000100:00100000:3.0:1788841269.584071:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584079:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584084:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584089:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584094:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584098:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584103:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584108:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584113:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584118:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584136:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584141:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584147:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584152:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584157:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584162:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584167:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584184:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584189:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584195:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584200:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584205:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584211:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584215:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584221:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584226:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584231:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584237:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584242:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584248:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584253:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584258:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584263:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584269:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584274:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584280:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584285:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584290:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584295:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584299:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584305:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584310:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584316:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584321:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584326:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584339:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584344:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584349:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584354:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584359:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584364:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584369:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584375:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584379:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584384:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584525:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584536:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584541:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584547:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584552:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584556:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584561:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584566:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.584578:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.585422:0:18718:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffffa04b679ea600:18718] 0 exiting: rc = 1 00000100:00100000:0.0:1788841269.585722:0:18719:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffffa04b679eb600:18719] 1 exiting: rc = 0 00000100:00100000:3.0:1788841269.585815:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.585821:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.585827:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.585859:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.585865:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.585871:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.585876:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.585881:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.585886:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.585892:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.585897:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.585902:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.585914:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.585928:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.585934:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.585947:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.585952:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.585957:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.585962:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.585967:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.585972:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.585977:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.585981:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.585986:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.585990:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.585995:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.586001:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.586006:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.586011:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.586017:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.586022:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.586027:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.586032:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.586037:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.586041:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.586046:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.586051:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.586057:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.586062:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.586067:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.586072:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.586077:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.586081:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.586086:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.586093:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.586097:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.586102:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.586106:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.586112:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.586116:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.586128:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.586134:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.586139:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.586144:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.586149:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.586154:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.586159:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.586164:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.586179:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.586184:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.586189:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.586194:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.586200:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.586205:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.587692:0:18721:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffffa04b46e1dc00:18721] 1 exiting: rc = 0 00000100:00100000:3.0:1788841269.588005:0:18722:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffffa04b67991a00:18722] 2 exiting: rc = 0 00000100:00100000:0.0:1788841269.598546:0:18720:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffffa04b46e1ca00:18720] 0 exiting: rc = 1 00000100:00100000:3.0:1788841269.598770:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.598778:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.598783:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.598790:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.598796:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.598812:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.598819:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.598825:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.598829:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.598872:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.598878:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.598883:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.598888:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.598895:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.598908:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.598915:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.598920:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.598926:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.598932:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.598938:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.598955:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.598961:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.598967:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.598974:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.598979:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.598985:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.598991:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.598996:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.599000:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.599006:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.599013:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.599019:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.599025:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.599031:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.599036:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.599041:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.599046:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.599052:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.599071:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.599078:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.599083:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.599089:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.599094:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.599099:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.599105:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.599111:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.599117:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.599123:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.599129:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.599135:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.599142:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.599148:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.599154:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.599159:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.599164:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.599195:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.599212:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.599226:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.599233:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.599238:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.599245:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.599251:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.599258:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788841269.599271:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.610790:0:18723:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffffa04b5c854a00:18723] 0 exiting: rc = 1 00000100:00100000:3.0:1788841269.617967:0:18724:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffffa04a4753e200:18724] 1 exiting: rc = 0 00000100:00100000:0.0:1788841269.618151:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618159:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618165:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618171:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618176:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618181:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618186:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618191:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618196:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618201:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618207:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618212:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618217:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618223:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618228:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618246:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618251:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618256:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618261:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618266:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618271:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618277:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618284:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618288:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618293:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618298:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618304:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618310:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618316:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618321:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618325:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618332:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618336:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618341:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618347:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618352:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618356:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618361:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618366:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618371:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618376:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618381:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618386:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618401:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618407:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618412:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618417:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618422:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618427:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618431:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618444:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618449:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618454:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618469:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618475:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618481:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618486:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618491:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618495:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618501:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618506:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618512:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618517:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.618522:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.619286:0:18725:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffffa04a47440600:18725] 0 exiting: rc = 1 00000100:00100000:2.0:1788841269.630368:0:18726:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffffa04a47440200:18726] 1 exiting: rc = 0 00000100:00100000:0.0:1788841269.630778:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.630797:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.630806:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.630813:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.630819:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.630825:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.630857:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.630866:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.630871:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.630878:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.630896:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.630905:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.630910:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.630917:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.630923:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.630928:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.630934:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.630939:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.630945:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.630952:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.630969:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.630975:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.630995:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.631002:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.631007:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.631013:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.631018:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.631025:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.631031:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.631037:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.631044:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.631049:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.631055:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.631060:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.631080:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.631086:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.631094:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.631099:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.631105:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.631111:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.631117:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.631124:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.631129:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.631136:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.631141:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.631147:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.631186:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.631194:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.631201:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.631207:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.631213:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.631219:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.631224:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.631231:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.631237:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.631250:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.631255:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.631261:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.631281:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.631288:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.631293:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.631299:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.631304:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788841269.631316:0:21384:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1788841269.646695:0:21384:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1788841293.931255:0:22150:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg407-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788841306.166424:0:22751:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788841306.166431:0:22751:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1788841306.166433:0:22751:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788841306.166728:0:22751:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffffa04a45f80000 00000020:01000004:0.0:1788841306.166744:0:22751:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1788841306.166752:0:22751:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788841306.166827:0:22751:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffffa04b6e038000) 00000020:00000080:1.0:1788841306.167117:0:22751:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788841306.270315:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788841306.271093:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788841306.280169:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1788841306.280383:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788841306.281108:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1788841306.281716:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788841306.282254:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1788841306.282995:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788841306.284046:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788841306.284303:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1788841306.287016:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788841306.287357:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788841306.287540:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1788841306.288025:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788841306.291924:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1788841306.293371:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1788841306.294017:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788841306.297392:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788841306.297991:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1788841306.298334:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788841306.299133:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788841306.299398:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788841306.299962:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1788841306.300181:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788841306.300381:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1788841306.305314:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1788841306.306015:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1788841306.307010:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1788841306.307309:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1788841306.307990:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1788841306.308714:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1788841306.309541:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1788841306.313313:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1788841306.314030:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1788841306.314324:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1788841306.314569:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1788841306.315027:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1788841306.315237:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1788841306.317949:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1788841306.319941:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1788841306.320976:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1788841306.321725:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1788841306.322312:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:1.0:1788841306.322735:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1788841306.324218:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1788841306.324758:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1788841306.325781:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1788841306.331296:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1788841306.332715:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1788841306.333298:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1788841306.334915:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1788841306.335158:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1788841306.335420:0:22751:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00080000:01000000:1.0:1788841306.338055:0:22751:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788841306.338300:0:22751:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788841306.338309:0:22751:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788841306.338322:0:22751:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5757cd208ac38019 00000020:01000004:1.0:1788841306.338330:0:22751:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1788841306.338336:0:22751:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788841306.338343:0:22751:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa04a45f80000 from MGS 00000020:01000004:1.0:1788841306.338347:0:22751:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788841306.338359:0:22751:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffffa04b7fa24d28) 00000020:00000080:1.0:1788841306.338371:0:22751:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788841306.338473:0:22751:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa04a45f80000 from MGS, refs=2 00080000:01000000:1.0:1788841306.338478:0:22751:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788841306.341099:0:22751:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5757cd208ac38027 00000100:00100000:1.0:1788841306.341292:0:22751:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788841306.341476:0:22751:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788841306.341485:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788841306.342323:0:22751:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788841306.342332:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788841306.352104:0:22751:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788841306.352331:0:22751:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788841306.352338:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788841306.367172:0:22751:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788841306.367200:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788841306.368032:0:22751:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788841306.368040:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788841306.368798:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841306.368801:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841306.368804:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841306.369529:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841306.369533:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841306.369535:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841306.370364:0:22751:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788841306.373768:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788841306.380558:0:22751:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1788841306.383162:0:22763:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788841306.383234:0:22751:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788841306.383290:0:22751:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788841306.384881:0:22751:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788841306.385245:0:22751:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788841306.385439:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788841306.385445:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788841306.396565:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788841306.396598:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788841306.397351:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788841306.397361:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788841306.398173:0:22751:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788841306.398194:0:22751:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.107@tcp' 00000020:01000004:0.0:1788841306.398197:0:22751:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788841306.398226:0:22751:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.107@tcp (typ=mgc) 00000020:00000080:0.0:1788841306.398237:0:22751:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.107@tcp (ffffa04b6e03cd28) 00000020:00000080:0.0:1788841306.398251:0:22751:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788841306.398321:0:22751:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa04a45f86800@MGC192.168.204.107@tcp: add connection 192.168.204.107@tcp at head 00010000:00010000:0.0:1788841306.398471:0:22751:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.107@tcp-0 is initialized 00000040:01000000:0.0:1788841306.398477:0:22751:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.107@tcp ctxt 1 is initialized 00000100:00080000:2.0:1788841306.398908:0:22768:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1788841306.400016:0:22769:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788841306.400096:0:22751:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.107@tcp (uuid a456da20-a415-4617-896c-ee7aa5e4c089) 00000020:00000080:0.0:1788841306.400119:0:22751:0:(genops.c:1385:class_connect()) connect: client a456da20-a415-4617-896c-ee7aa5e4c089, cookie 0x5757cd208ac38035 00000100:00080000:0.0:1788841306.400132:0:22751:0:(import.c:510:import_select_connection()) MGC192.168.204.107@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788841306.400148:0:22751:0:(import.c:624:import_select_connection()) MGC192.168.204.107@tcp: import ffffa04a45f86800 using connection 192.168.204.107@tcp/0@lo 00000100:00100000:0.0:1788841306.400182:0:22751:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa04b7c028380 x1875735413499776/t0(0) o250->MGC192.168.204.107@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788841306.400231:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c028380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a456da20-a415-4617-896c-ee7aa5e4c089:3648:1875735413499776:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788841306.400303:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788841306.400366:0:22751:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import a456da20-a415-4617-896c-ee7aa5e4c089->MGS 00000020:01000004:0.0:1788841306.400386:0:22751:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788841306.400407:0:22751:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788841306.400421:0:22751:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffffa04b6e0399b8) 00000020:00000080:0.0:1788841306.400433:0:22751:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788841306.401741:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413499776 00000100:00100000:2.0:1788841306.401766:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413499776 00000100:00100000:2.0:1788841306.401805:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788841306.401813:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b67a3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3648:x1875735413499776:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788841306.401864:0:22764:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from a456da20-a415-4617-896c-ee7aa5e4c089@0@lo t0 exp 0000000000000000 cur 740 last 0 00000020:00000080:2.0:1788841306.401892:0:22764:0:(genops.c:1385:class_connect()) connect: client a456da20-a415-4617-896c-ee7aa5e4c089, cookie 0x5757cd208ac38043 00000100:00080000:2.0:1788841306.402032:0:22764:0:(import.c:65:import_set_state_nolock()) ffffa04b7d0db800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788841306.402130:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b67a3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+5:3648:x1875735413499776:12345-0@lo:250:mount.lustre.0 Request processed in 316us (1826us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841306.402138:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788841306.406176:0:3648:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.107@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788841306.406193:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.107@tcp: connect to target with instance 0 00000100:00080000:1.0:1788841306.406203:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.107@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788841306.406209:0:3648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788841306.406213:0:3648:0:(import.c:65:import_set_state_nolock()) ffffa04a45f86800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788841306.406217:0:3648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788841306.407525:0:3648:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788841306.407538:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c028380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a456da20-a415-4617-896c-ee7aa5e4c089:3648:1875735413499776:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788841306.423665:0:22751:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788841306.423967:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788841306.423974:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788841306.428467:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788841306.428549:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788841306.432886:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788841306.432904:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788841306.436451:0:22751:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788841306.436721:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788841306.436730:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788841306.439500:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788841306.439514:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788841306.482490:0:22751:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788841306.482741:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788841306.482754:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788841306.484420:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788841306.484432:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788841306.485101:0:22751:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788841306.485299:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788841306.485304:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788841306.486048:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788841306.486056:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788841306.486458:0:22751:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788841306.486635:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788841306.486640:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788841306.487214:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788841306.487220:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788841306.487709:0:22751:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788841306.488123:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788841306.488128:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788841306.488485:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788841306.488491:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788841306.511060:0:22751:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788841306.511308:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788841306.511314:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788841306.517166:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788841306.517185:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788841306.520347:0:22751:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788841306.520360:0:22751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788841306.521348:0:22751:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788841306.521374:0:22751:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1788841306.521380:0:22751:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.107@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788841306.521474:0:22751:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.107@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788841306.521503:0:22751:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.107@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788841306.521508:0:22751:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788841306.521509:0:22751:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788841306.521511:0:22751:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788841306.521512:0:22751:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788841306.521516:0:22751:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788841306.521517:0:22751:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788841306.521519:0:22751:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788841306.521520:0:22751:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788841306.521522:0:22751:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788841306.521523:0:22751:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788841306.521525:0:22751:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788841306.521527:0:22751:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788841306.521528:0:22751:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788841306.521529:0:22751:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788841306.521530:0:22751:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788841306.521531:0:22751:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788841306.521532:0:22751:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788841306.521533:0:22751:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788841306.521534:0:22751:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788841306.521535:0:22751:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788841306.521536:0:22751:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788841306.521566:0:22751:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788841306.521583:0:22751:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c029880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:22751:1875735413499904:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788841306.521642:0:22751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841306.521694:0:22751:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b6e077480 going to sleep for 11 seconds 00000100:00100000:2.0:1788841306.521779:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413499904 00000100:00100000:2.0:1788841306.521786:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413499904 00000100:00100000:2.0:1788841306.521855:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788841306.521864:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b67a38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+5:22751:x1875735413499904:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788841306.521903:0:22767:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788841306.521905:0:22767:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788841306.521908:0:22767:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1788841306.522328:0:22788:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788841306.522718:0:22767:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:2.0:1788841306.524440:0:22789:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788841306.524447:0:22789:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1788841306.524450:0:22789:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788841306.524453:0:22789:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788841306.524624:0:22789:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1788841306.528130:0:22767:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788841306.528144:0:22767:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788841306.530722:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b67a38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+5:22751:x1875735413499904:12345-0@lo:253:mount.lustre.0 Request processed in 8850us (9070us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841306.530759:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788841306.531030:0:22751:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c029880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:22751:1875735413499904:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788841306.531044:0:22751:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788841306.531048:0:22751:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788841306.531049:0:22751:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788841306.531051:0:22751:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788841306.531052:0:22751:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788841306.531053:0:22751:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788841306.531055:0:22751:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788841306.531056:0:22751:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788841306.531058:0:22751:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788841306.531060:0:22751:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788841306.531061:0:22751:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788841306.531080:0:22751:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa04a45f80000 from lustre-MDT0000 10000000:01000000:0.0:1788841306.531111:0:22751:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788841306.531114:0:22751:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788841306.531118:0:22751:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffffa04b6e03cd28 10000000:01000000:0.0:1788841306.531128:0:22751:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788841306.531135:0:22751:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffffa04b6e03cd28 from 1 10000000:01000000:0.0:1788841306.531138:0:22751:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788841306.531174:0:22751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04a474afa00/0x5757cd208ac3804a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841306.531184:0:22751:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.107@tcp lock: ffffa04a474afa00/0x5757cd208ac3804a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841306.531193:0:22751:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.107@tcp lock: ffffa04a474afa00/0x5757cd208ac3804a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841306.531212:0:22751:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c029880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:22751:1875735413500032:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788841306.531247:0:22751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841306.531273:0:22751:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b6e077180 going to sleep for 11 seconds 00000100:00100000:2.0:1788841306.531321:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413500032 00000100:00100000:2.0:1788841306.531327:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413500032 00000100:00100000:2.0:1788841306.531367:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788841306.531376:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b67a3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+5:22751:x1875735413500032:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788841306.531388:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841306.531402:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa04b81b5c600/0x5757cd208ac38051 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5757cd208ac3804a expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841306.531435:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa04b81b5c600/0x5757cd208ac38051 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5757cd208ac3804a expref: 6 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841306.531446:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa04b81b5c600/0x5757cd208ac38051 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5757cd208ac3804a expref: 6 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841306.531454:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04b81b5c600, rc 0) 00000100:00100000:2.0:1788841306.531498:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b67a3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+6:22751:x1875735413500032:12345-0@lo:101:mount.lustre.0 Request processed in 123us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841306.531504:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788841306.531568:0:22751:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c029880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:22751:1875735413500032:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788841306.531581:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.107@tcp lock: ffffa04a474afa00/0x5757cd208ac3804a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac38051 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841306.531590:0:22751:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.107@tcp lock: ffffa04a474afa00/0x5757cd208ac3804a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5757cd208ac38051 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841306.531642:0:22751:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:22751:1875735413500160:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788841306.531667:0:22751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841306.531700:0:22751:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b7d163e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788841306.531741:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413500160 00000100:00100000:2.0:1788841306.531751:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413500160 00000100:00100000:2.0:1788841306.531782:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788841306.531789:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b67a38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+6:22751:x1875735413500160:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788841306.531881:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b67a38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+6:22751:x1875735413500160:12345-0@lo:501:mount.lustre.0 Request processed in 94us (213us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788841306.531888:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788841306.532037:0:22751:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:22751:1875735413500160:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788841306.532065:0:22751:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.107@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788841306.532083:0:22751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04a474afa00/0x5757cd208ac3804a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac38051 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841306.532091:0:22751:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.107@tcp lock: ffffa04a474afa00/0x5757cd208ac3804a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac38051 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788841306.532098:0:22751:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa04a45f80000 10000000:01000000:3.0:1788841306.532102:0:22751:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788841306.532106:0:22751:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffffa04a45f80000 10000000:01000000:3.0:1788841306.532108:0:22751:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788841306.532111:0:22751:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffffa04a45f80000 from 1 10000000:01000000:3.0:1788841306.532113:0:22751:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788841306.532129:0:22751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b7a722800/0x5757cd208ac38058 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841306.532146:0:22751:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.107@tcp lock: ffffa04b7a722800/0x5757cd208ac38058 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841306.532154:0:22751:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.107@tcp lock: ffffa04b7a722800/0x5757cd208ac38058 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841306.532165:0:22751:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:22751:1875735413500288:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788841306.532189:0:22751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841306.532201:0:22751:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b7d163e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788841306.532268:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413500288 00000100:00100000:0.0:1788841306.532272:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413500288 00000100:00100000:0.0:1788841306.532302:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788841306.532309:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b67a39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+6:22751:x1875735413500288:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788841306.532316:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841306.532328:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa04a474ae800/0x5757cd208ac3805f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5757cd208ac38058 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841306.532343:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa04a474ae800/0x5757cd208ac3805f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5757cd208ac38058 expref: 7 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841306.532351:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa04a474ae800/0x5757cd208ac3805f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5757cd208ac38058 expref: 7 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841306.532358:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04a474ae800, rc 0) 00000100:00100000:0.0:1788841306.532390:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b67a39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+7:22751:x1875735413500288:12345-0@lo:101:mount.lustre.0 Request processed in 81us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841306.532397:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788841306.532462:0:22751:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:22751:1875735413500288:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788841306.532471:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.107@tcp lock: ffffa04b7a722800/0x5757cd208ac38058 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac3805f expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841306.532478:0:22751:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.107@tcp lock: ffffa04b7a722800/0x5757cd208ac38058 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5757cd208ac3805f expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788841306.532488:0:22751:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.107@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788841306.532492:0:22751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b7a722800/0x5757cd208ac38058 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac3805f expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841306.532498:0:22751:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.107@tcp lock: ffffa04b7a722800/0x5757cd208ac38058 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac3805f expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788841306.532502:0:22751:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788841306.532506:0:22751:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788841306.532509:0:22751:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffffa04a45f80000 10000000:01000000:3.0:1788841306.532512:0:22751:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788841306.532519:0:22751:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788841306.532521:0:22751:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788841306.532534:0:22751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b7a722a00/0x5757cd208ac38066 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841306.532542:0:22751:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.107@tcp lock: ffffa04b7a722a00/0x5757cd208ac38066 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841306.532548:0:22751:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.107@tcp lock: ffffa04b7a722a00/0x5757cd208ac38066 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841306.532559:0:22751:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:22751:1875735413500416:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788841306.532582:0:22751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841306.532608:0:22751:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b7d163e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788841306.532732:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413500416 00000100:00100000:2.0:1788841306.532737:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413500416 00000100:00100000:2.0:1788841306.532774:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788841306.532781:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b67a3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+7:22751:x1875735413500416:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788841306.532788:0:22767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841306.532795:0:22767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa04b81b5ca00/0x5757cd208ac3806d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5757cd208ac38066 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841306.532816:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa04b81b5ca00/0x5757cd208ac3806d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5757cd208ac38066 expref: 8 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841306.532854:0:22767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa04b81b5ca00/0x5757cd208ac3806d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5757cd208ac38066 expref: 8 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841306.532861:0:22767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04b81b5ca00, rc 0) 00000100:00100000:2.0:1788841306.532889:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b67a3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+8:22751:x1875735413500416:12345-0@lo:101:mount.lustre.0 Request processed in 109us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841306.532895:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788841306.533170:0:22751:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:22751:1875735413500416:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788841306.533182:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.107@tcp lock: ffffa04b7a722a00/0x5757cd208ac38066 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac3806d expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841306.533191:0:22751:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.107@tcp lock: ffffa04b7a722a00/0x5757cd208ac38066 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5757cd208ac3806d expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841306.533235:0:22751:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:22751:1875735413500544:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788841306.533261:0:22751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841306.533289:0:22751:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b7d163e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788841306.533335:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413500544 00000100:00100000:2.0:1788841306.533338:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413500544 00000100:00100000:2.0:1788841306.533368:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788841306.533375:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47cca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+8:22751:x1875735413500544:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788841306.533498:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47cca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+9:22751:x1875735413500544:12345-0@lo:501:mount.lustre.0 Request processed in 123us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841306.533504:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788841306.533568:0:22751:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:22751:1875735413500544:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788841306.533596:0:22751:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:22751:1875735413500672:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788841306.533634:0:22751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841306.533662:0:22751:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b7d163e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788841306.533717:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413500672 00000100:00100000:0.0:1788841306.533721:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413500672 00000100:00100000:0.0:1788841306.533756:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788841306.533763:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47ccac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+9:22751:x1875735413500672:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788841306.534657:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47ccac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+9:22751:x1875735413500672:12345-0@lo:503:mount.lustre.0 Request processed in 889us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841306.534669:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788841306.534777:0:22751:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:22751:1875735413500672:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788841306.535386:0:22790:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c029500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a456da20-a415-4617-896c-ee7aa5e4c089:22790:1875735413500800:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788841306.535433:0:22790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841306.535471:0:22790:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b6e077d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788841306.535524:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413500800 00000100:00100000:3.0:1788841306.535530:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413500800 00000100:00100000:3.0:1788841306.535569:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788841306.535577:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47cc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+9:22790:x1875735413500800:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788841306.536279:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47cc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+9:22790:x1875735413500800:12345-0@lo:502:llog_process_th.0 Request processed in 701us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841306.536288:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788841306.536385:0:22790:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c029500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a456da20-a415-4617-896c-ee7aa5e4c089:22790:1875735413500800:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788841306.536409:0:22790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788841306.536420:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788841306.536422:0:22790:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788841306.536427:0:22790:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788841306.536430:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788841306.536444:0:22790:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffffa04b6e03b370) 00000020:00000080:0.0:1788841306.536459:0:22790:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788841306.536466:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788841306.536540:0:22790:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788841306.536547:0:22790:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5757cd208ac3807b 00000020:00000080:1.0:1788841306.537249:0:22790:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788841306.537255:0:22790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788841306.537259:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788841306.537260:0:22790:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788841306.537264:0:22790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788841306.537268:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788841306.537270:0:22790:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788841306.537274:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788841306.537282:0:22790:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffffa04b7fa219b8) 00000020:00000080:1.0:1788841306.537294:0:22790:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788841306.537298:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788841306.537307:0:22790:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788841306.537309:0:22790:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788841306.537316:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788841306.537386:0:22790:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa04a45f80000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788841306.537399:0:22790:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffffa04b7fa20000) 00000020:00000080:1.0:1788841306.537406:0:22790:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788841306.537462:0:22790:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788841306.537468:0:22790:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5757cd208ac38090 00000020:00000080:1.0:1788841306.537561:0:22790:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788841306.537567:0:22790:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788841306.537570:0:22790:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x5757cd208ac38097 00080000:01000000:1.0:1788841306.537575:0:22790:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788841306.537578:0:22790:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5757cd208ac3809e 00010000:00010000:2.0:1788841306.625197:0:22790:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788841306.630058:0:22790:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934638 00000001:00080000:2.0:1788841306.630861:0:22790:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788841306.631340:0:22790:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffffa04b5c84cd28) 00000020:00000080:2.0:1788841306.631359:0:22790:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788841306.631449:0:22790:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788841306.631458:0:22790:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5757cd208ac380ac 00000020:00000080:1.0:1788841306.641083:0:22790:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788841306.646001:0:22790:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x5757cd208ac380b3 00000020:00000080:2.0:1788841306.648085:0:22790:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788841306.648100:0:22790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788841306.648109:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788841306.648111:0:22790:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788841306.648115:0:22790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788841306.648127:0:22790:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1788841306.648128:0:22790:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788841306.648130:0:22790:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788841306.648131:0:22790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788841306.648134:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788841306.648135:0:22790:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788841306.648137:0:22790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788841306.648142:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788841306.648144:0:22790:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788841306.648149:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788841306.648199:0:22790:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788841306.648217:0:22790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788841306.648221:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788841306.648222:0:22790:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788841306.648225:0:22790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788841306.648228:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788841306.648229:0:22790:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1788841306.648231:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788841306.648237:0:22790:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.107@tcp to nid 0x20000c0a8cc6b (192.168.204.107@tcp) 00000020:00000080:2.0:1788841306.648264:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788841306.648280:0:22790:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffffa04b5c84b370) 00000020:00000080:2.0:1788841306.648295:0:22790:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788841306.648300:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788841306.648388:0:22790:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1788841306.648394:0:22790:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788841306.648402:0:22790:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5757cd208ac380c1 00010000:00080000:2.0:1788841306.648432:0:22790:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa04b7f429000@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.107@tcp at head 00010000:00010000:3.0:1788841306.656303:0:22790:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:0.0:1788841306.660407:0:22790:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788841306.660424:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788841306.660485:0:22790:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788841306.660508:0:22790:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5757cd208ac380c8 00000100:00080000:0.0:1788841306.660519:0:22790:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788841306.660525:0:22790:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffffa04b7f429000 using connection 192.168.204.107@tcp/0@lo 00000100:00100000:0.0:1788841306.660560:0:22790:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa04b7c029500 x1875735413500928/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788841306.660600:0:22790:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788841306.660691:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c029500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875735413500928:0@lo:38:llog_process_th.0 00000020:01000000:0.0:1788841306.660729:0:22790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788841306.660732:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788841306.660734:0:22790:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1788841306.660736:0:22790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788841306.660739:0:22790:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:0.0:1788841306.660740:0:22790:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788841306.660748:0:22790:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788841306.660750:0:22790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788841306.660753:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788841306.660754:0:22790:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788841306.660756:0:22790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788841306.660761:0:22790:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788841306.660764:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788841306.660765:0:22790:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788841306.660767:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788841306.660771:0:22790:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.107@tcp to nid 0x20000c0a8cc6b (192.168.204.107@tcp) 00000100:00100000:1.0:1788841306.660774:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1788841306.663873:0:22790:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788841306.663885:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788841306.663907:0:22790:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffffa04b81af8000) 00000020:00000080:0.0:1788841306.663931:0:22790:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1788841306.663939:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788841306.664034:0:22790:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788841306.664041:0:22790:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788841306.664049:0:22790:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5757cd208ac380d6 00010000:00080000:0.0:1788841306.664105:0:22790:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa04b5210f000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.107@tcp at head 00010000:00010000:0.0:1788841306.664329:0:22790:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1788841306.667904:0:22790:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788841306.668231:0:22790:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1788841306.669167:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413500928 00000100:00100000:1.0:1788841306.669178:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413500928 00000100:00100000:1.0:1788841306.669221:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788841306.669229:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6d9e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1875735413500928:12345-0@lo:38:llog_process_th.0 00010000:00020000:1.0:1788841306.669249:0:22777:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:00080000:0.0:1788841306.674656:0:22790:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788841306.675349:0:22790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1788841306.684405:0:22790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:3.0:1788841306.687583:0:22796:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788841306.687594:0:22796:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788841306.695344:0:22790:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788841306.695360:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788841306.695436:0:22790:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788841306.695458:0:22790:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5757cd208ac380dd 00000100:00080000:0.0:1788841306.695469:0:22790:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788841306.695475:0:22790:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffffa04b5210f000 using connection 192.168.204.107@tcp/0@lo 00000100:00100000:0.0:1788841306.695531:0:22790:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa04b7c02bb80 x1875735413501056/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788841306.695599:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c02bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875735413501056:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788841306.695655:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875735413501056 offset 0 length 520: 4 00000100:00080000:0.0:1788841306.695717:0:22790:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788841306.695816:0:22790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788841306.695821:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788841306.695823:0:22790:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788841306.695826:0:22790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788841306.695829:0:22790:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:0.0:1788841306.695830:0:22790:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788841306.695848:0:22790:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788841306.695850:0:22790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788841306.695854:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788841306.695855:0:22790:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788841306.695857:0:22790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788841306.695862:0:22790:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788841306.695865:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788841306.695867:0:22790:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788841306.695869:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788841306.695873:0:22790:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.107@tcp to nid 0x20000c0a8cc6b (192.168.204.107@tcp) 00000020:01000000:0.0:1788841306.695895:0:22790:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788841306.695898:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788841306.695910:0:22790:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffffa04b81afcd28) 00000020:00000080:0.0:1788841306.695922:0:22790:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1788841306.695927:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788841306.695994:0:22790:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788841306.696001:0:22790:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:0.0:1788841306.696008:0:22790:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5757cd208ac380eb 00010000:00080000:0.0:1788841306.696037:0:22790:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa04a47d02000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.107@tcp at head 00010000:00010000:0.0:1788841306.696232:0:22790:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1788841306.696304:0:22790:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788841306.696318:0:22790:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788841306.701497:0:22790:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788841306.701937:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6d9e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1875735413500928:12345-0@lo:38:llog_process_th.0 Request processed in 32701us (41155us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788841306.701951:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:0.0:1788841306.701953:0:22790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:0.0:1788841306.702094:0:22790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:0.0:1788841306.702541:0:22798:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788841306.702546:0:22798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788841306.703274:0:22790:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788841306.703287:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788841306.703323:0:22790:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788841306.703343:0:22790:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5757cd208ac380f2 00000100:00080000:0.0:1788841306.703352:0:22790:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788841306.703358:0:22790:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa04a47d02000 using connection 192.168.204.107@tcp/0@lo 00000100:00100000:0.0:1788841306.703390:0:22790:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa04b7c02b800 x1875735413501184/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788841306.703407:0:22790:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788841306.703536:0:22790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788841306.703540:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788841306.703542:0:22790:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788841306.703544:0:22790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788841306.703548:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788841306.703549:0:22790:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788841306.703552:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788841306.703553:0:22790:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788841306.703556:0:22790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788841306.703558:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788841306.703565:0:22790:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788841306.703568:0:22790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788841306.703570:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788841306.703571:0:22790:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788841306.703575:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788841306.703604:0:22790:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c02ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a456da20-a415-4617-896c-ee7aa5e4c089:22790:1875735413501312:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788841306.703685:0:22790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841306.703724:0:22790:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b6df38c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788841306.707227:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413501312 00000100:00100000:3.0:1788841306.707245:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413501312 00000100:00100000:3.0:1788841306.707308:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788841306.707319:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47cc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+9:22790:x1875735413501312:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788841306.707491:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47cc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+9:22790:x1875735413501312:12345-0@lo:502:llog_process_th.0 Request processed in 173us (3815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841306.707499:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1788841306.707656:0:3648:0:(import.c:65:import_set_state_nolock()) ffffa04b7f429000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788841306.707663:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788841306.707686:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c029500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875735413500928:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788841306.707728:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c02b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875735413501184:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788841306.707771:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875735413501184 offset 0 length 520: 4 00000100:00100000:0.0:1788841306.707934:0:22790:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c02ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a456da20-a415-4617-896c-ee7aa5e4c089:22790:1875735413501312:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788841306.707963:0:22790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788841306.707970:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788841306.707973:0:22790:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788841306.707977:0:22790:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1788841306.708153:0:22751:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1788841306.708172:0:22751:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.107@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788841306.708192:0:22751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b7a722a00/0x5757cd208ac38066 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac3806d expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841306.708204:0:22751:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.107@tcp lock: ffffa04b7a722a00/0x5757cd208ac38066 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac3806d expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788841306.708213:0:22751:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa04a45f80000 from 1 10000000:01000000:3.0:1788841306.708221:0:22751:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788841306.708253:0:22751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b7a723800/0x5757cd208ac380f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841306.708261:0:22751:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.107@tcp lock: ffffa04b7a723800/0x5757cd208ac380f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841306.708271:0:22751:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.107@tcp lock: ffffa04b7a723800/0x5757cd208ac380f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841306.708288:0:22751:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:22751:1875735413501440:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788841306.708319:0:22751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841306.708348:0:22751:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b7f40f900 going to sleep for 11 seconds 00000100:00100000:0.0:1788841306.708444:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413501440 00000100:00100000:0.0:1788841306.708450:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413501440 00000100:00100000:0.0:1788841306.708486:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788841306.708494:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47cc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+9:22751:x1875735413501440:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788841306.708504:0:22767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841306.708516:0:22767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa04a474afc00/0x5757cd208ac38100 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5757cd208ac380f9 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841306.708538:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa04a474afc00/0x5757cd208ac38100 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5757cd208ac380f9 expref: 10 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841306.708549:0:22767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa04a474afc00/0x5757cd208ac38100 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5757cd208ac380f9 expref: 10 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841306.708558:0:22767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04a474afc00, rc 0) 00000100:00100000:0.0:1788841306.708599:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47cc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+10:22751:x1875735413501440:12345-0@lo:101:mount.lustre.0 Request processed in 107us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841306.708615:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788841306.708697:0:22751:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:22751:1875735413501440:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788841306.708710:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.107@tcp lock: ffffa04b7a723800/0x5757cd208ac380f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac38100 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841306.708719:0:22751:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.107@tcp lock: ffffa04b7a723800/0x5757cd208ac380f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5757cd208ac38100 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841306.709265:0:22751:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47b47480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:22751:1875735413501568:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788841306.709309:0:22751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841306.709331:0:22751:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b7f489900 going to sleep for 11 seconds 00000100:00100000:0.0:1788841306.709480:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413501568 00000100:00100000:0.0:1788841306.709486:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413501568 00000100:00100000:0.0:1788841306.709511:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788841306.709520:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47cca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+10:22751:x1875735413501568:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788841306.709536:0:22767:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788841306.709541:0:22767:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788841306.709613:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47cca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+10:22751:x1875735413501568:12345-0@lo:256:mount.lustre.0 Request processed in 94us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841306.709621:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788841306.709703:0:22751:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47b47480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:22751:1875735413501568:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788841306.710562:0:22751:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.107@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788841306.710626:0:22751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b7a723800/0x5757cd208ac380f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac38100 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841306.710638:0:22751:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.107@tcp lock: ffffa04b7a723800/0x5757cd208ac380f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac38100 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788841306.710646:0:22751:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa04a45f80000 from 1 10000000:01000000:2.0:1788841306.710649:0:22751:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788841306.710692:0:22751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b81b5de00/0x5757cd208ac38107 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841306.710701:0:22751:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.107@tcp lock: ffffa04b81b5de00/0x5757cd208ac38107 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841306.710768:0:22751:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.107@tcp lock: ffffa04b81b5de00/0x5757cd208ac38107 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841306.710789:0:22751:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47b47480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:22751:1875735413501696:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788841306.710856:0:22751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841306.710892:0:22751:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b7f489900 going to sleep for 11 seconds 00000100:00100000:3.0:1788841306.711063:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413501696 00000100:00100000:3.0:1788841306.711069:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413501696 00000100:00100000:3.0:1788841306.711112:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788841306.711120:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47ccb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+10:22751:x1875735413501696:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788841306.711131:0:22767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788841306.711145:0:22767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa04b7a722c00/0x5757cd208ac3810e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5757cd208ac38107 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841306.711166:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa04b7a722c00/0x5757cd208ac3810e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5757cd208ac38107 expref: 11 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841306.711176:0:22767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa04b7a722c00/0x5757cd208ac3810e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5757cd208ac38107 expref: 11 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841306.711184:0:22767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04b7a722c00, rc 0) 00000100:00100000:3.0:1788841306.711229:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47ccb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+11:22751:x1875735413501696:12345-0@lo:101:mount.lustre.0 Request processed in 110us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841306.711245:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788841306.715089:0:22751:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47b47480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:22751:1875735413501696:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788841306.715122:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.107@tcp lock: ffffa04b81b5de00/0x5757cd208ac38107 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac3810e expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841306.715135:0:22751:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.107@tcp lock: ffffa04b81b5de00/0x5757cd208ac38107 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5757cd208ac3810e expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841306.715230:0:22751:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47b47480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:22751:1875735413501824:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788841306.715288:0:22751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841306.715331:0:22751:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b7f489900 going to sleep for 11 seconds 00000100:00100000:3.0:1788841306.715395:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413501824 00000100:00100000:3.0:1788841306.715401:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413501824 00000100:00100000:3.0:1788841306.715449:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788841306.715458:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47ccb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+11:22751:x1875735413501824:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788841306.715704:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47ccb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+11:22751:x1875735413501824:12345-0@lo:501:mount.lustre.0 Request processed in 246us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841306.715712:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788841306.715978:0:22751:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47b47480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:22751:1875735413501824:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788841306.716012:0:22751:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6d9e1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:22751:1875735413501952:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788841306.716062:0:22751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841306.716092:0:22751:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b50dc80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788841306.716151:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413501952 00000100:00100000:0.0:1788841306.716156:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413501952 00000100:00100000:0.0:1788841306.716329:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788841306.716338:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47cc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+11:22751:x1875735413501952:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788841306.716433:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47cc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+11:22751:x1875735413501952:12345-0@lo:503:mount.lustre.0 Request processed in 97us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841306.716440:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788841306.716519:0:22751:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6d9e1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:22751:1875735413501952:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788841306.717463:0:22800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6d9e1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a456da20-a415-4617-896c-ee7aa5e4c089:22800:1875735413502080:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788841306.717512:0:22800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841306.717549:0:22800:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b50dc86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788841306.717607:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413502080 00000100:00100000:3.0:1788841306.717613:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413502080 00000100:00100000:3.0:1788841306.717649:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788841306.717658:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47ccb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+11:22800:x1875735413502080:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788841306.718363:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47ccb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+11:22800:x1875735413502080:12345-0@lo:502:llog_process_th.0 Request processed in 702us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841306.718371:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788841306.718474:0:22800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6d9e1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a456da20-a415-4617-896c-ee7aa5e4c089:22800:1875735413502080:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788841306.718504:0:22800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788841306.718514:0:22800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788841306.718516:0:22800:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788841306.718525:0:22800:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa04a45f80000 00000020:00000080:1.0:1788841306.718528:0:22800:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788841306.718535:0:22800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788841306.718537:0:22800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788841306.718539:0:22800:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788841306.718541:0:22800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788841306.718543:0:22800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788841306.718544:0:22800:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788841306.718547:0:22800:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa04a45f80000 00000020:00000080:1.0:1788841306.718549:0:22800:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788841306.718619:0:22800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788841306.718622:0:22800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788841306.718624:0:22800:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788841306.718627:0:22800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788841306.718629:0:22800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788841306.718630:0:22800:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788841306.718634:0:22800:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa04a45f80000 00000020:00000080:1.0:1788841306.718636:0:22800:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788841306.718655:0:22800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788841306.718659:0:22800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788841306.718660:0:22800:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788841306.718662:0:22800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788841306.718673:0:22800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788841306.718684:0:22800:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788841306.718689:0:22800:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa04a45f80000 00000020:00000080:1.0:1788841306.718691:0:22800:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788841306.718732:0:22800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6d9e1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a456da20-a415-4617-896c-ee7aa5e4c089:22800:1875735413502208:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788841306.718779:0:22800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841306.719852:0:22800:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b50dc86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788841306.721193:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413502208 00000100:00100000:3.0:1788841306.721207:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413502208 00000100:00100000:3.0:1788841306.721262:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788841306.721273:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47cc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+11:22800:x1875735413502208:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788841306.721426:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47cc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+11:22800:x1875735413502208:12345-0@lo:502:llog_process_th.0 Request processed in 154us (2646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841306.721434:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788841306.723987:0:22800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6d9e1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a456da20-a415-4617-896c-ee7aa5e4c089:22800:1875735413502208:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788841306.724031:0:22800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788841306.724039:0:22800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788841306.724041:0:22800:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788841306.724046:0:22800:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788841306.724119:0:22751:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788841306.724142:0:22751:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.107@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788841306.724160:0:22751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b81b5de00/0x5757cd208ac38107 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac3810e expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841306.724183:0:22751:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.107@tcp lock: ffffa04b81b5de00/0x5757cd208ac38107 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac3810e expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788841306.724235:0:22751:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788841306.724239:0:22751:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa04a45f80000 10000000:01000000:2.0:1788841306.724242:0:22751:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa04a45f80000 10000000:01000000:2.0:1788841306.724246:0:22751:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788841306.724252:0:22751:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa04a45f80000 from 1 10000000:01000000:2.0:1788841306.724257:0:22751:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788841306.724290:0:22751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b81b5ce00/0x5757cd208ac38115 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841306.724299:0:22751:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.107@tcp lock: ffffa04b81b5ce00/0x5757cd208ac38115 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841306.724310:0:22751:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.107@tcp lock: ffffa04b81b5ce00/0x5757cd208ac38115 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841306.724330:0:22751:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47b44a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:22751:1875735413502336:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788841306.724389:0:22751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841306.725269:0:22751:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b48a6b540 going to sleep for 11 seconds 00000100:00100000:3.0:1788841306.725422:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413502336 00000100:00100000:3.0:1788841306.725430:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413502336 00000100:00100000:3.0:1788841306.725474:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788841306.725483:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47ccbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+11:22751:x1875735413502336:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788841306.725502:0:22767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788841306.725515:0:22767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa04b7a723600/0x5757cd208ac3811c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5757cd208ac38115 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841306.725538:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa04b7a723600/0x5757cd208ac3811c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5757cd208ac38115 expref: 12 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841306.725548:0:22767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa04b7a723600/0x5757cd208ac3811c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5757cd208ac38115 expref: 12 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841306.725557:0:22767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04b7a723600, rc 0) 00000100:00100000:3.0:1788841306.725604:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47ccbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+12:22751:x1875735413502336:12345-0@lo:101:mount.lustre.0 Request processed in 122us (1215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841306.725610:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788841306.727531:0:22751:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47b44a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:22751:1875735413502336:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788841306.727558:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.107@tcp lock: ffffa04b81b5ce00/0x5757cd208ac38115 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac3811c expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841306.727570:0:22751:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.107@tcp lock: ffffa04b81b5ce00/0x5757cd208ac38115 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5757cd208ac3811c expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841306.727662:0:22751:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47b44a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:22751:1875735413502464:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788841306.727728:0:22751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841306.727770:0:22751:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b48a6b540 going to sleep for 11 seconds 00000100:00100000:2.0:1788841306.727790:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413502464 00000100:00100000:2.0:1788841306.727795:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413502464 00000100:00100000:2.0:1788841306.728891:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788841306.728902:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47cc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+12:22751:x1875735413502464:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788841306.729056:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47cc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+12:22751:x1875735413502464:12345-0@lo:501:mount.lustre.0 Request processed in 156us (1327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841306.729064:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788841306.729117:0:22751:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47b44a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:22751:1875735413502464:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788841306.729169:0:22751:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47b44a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:22751:1875735413502592:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788841306.729208:0:22751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841306.729224:0:22751:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b48a6b540 going to sleep for 11 seconds 00000100:00100000:2.0:1788841306.729239:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413502592 00000100:00100000:2.0:1788841306.729245:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413502592 00000100:00100000:2.0:1788841306.729262:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788841306.729269:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47cc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+12:22751:x1875735413502592:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788841306.729340:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47cc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+12:22751:x1875735413502592:12345-0@lo:503:mount.lustre.0 Request processed in 71us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841306.729347:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788841306.729385:0:22751:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47b44a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:22751:1875735413502592:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788841306.730971:0:22804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c02ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a456da20-a415-4617-896c-ee7aa5e4c089:22804:1875735413502720:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788841306.731038:0:22804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841306.731073:0:22804:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b6df38180 going to sleep for 11 seconds 00000100:00100000:2.0:1788841306.732066:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413502720 00000100:00100000:2.0:1788841306.732082:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413502720 00000100:00100000:2.0:1788841306.732122:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788841306.732480:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a46968050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+12:22804:x1875735413502720:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788841306.732631:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a46968050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+12:22804:x1875735413502720:12345-0@lo:502:llog_process_th.0 Request processed in 501us (1593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841306.732639:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788841306.732867:0:22804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c02ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a456da20-a415-4617-896c-ee7aa5e4c089:22804:1875735413502720:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788841306.732930:0:22804:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788841306.732945:0:22804:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffffa04b7fa23370) 00000020:00000080:1.0:1788841306.732962:0:22804:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1788841306.733048:0:22804:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa04a45f80000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788841306.733052:0:22804:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa04a45f80000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788841306.733055:0:22804:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa04a45f80000 4 00010000:00080000:1.0:1788841306.733082:0:22804:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa04a45ff4800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.107@tcp at head 00010000:00010000:1.0:1788841306.734611:0:22804:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:1.0:1788841306.734861:0:22804:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788841306.734902:0:22804:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788841306.734920:0:22804:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x5757cd208ac3812a 00000100:00080000:1.0:1788841306.734932:0:22804:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788841306.734937:0:22804:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffffa04a45ff4800 using connection 192.168.204.107@tcp/0@lo 00000100:00100000:1.0:1788841306.734970:0:22804:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa04b6d9e0700 x1875735413502848/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788841306.735004:0:22804:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788841306.737217:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6d9e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875735413502848:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788841306.737292:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841306.737970:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413502848 00000100:00100000:3.0:1788841306.737979:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413502848 00000100:00100000:3.0:1788841306.738019:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788841306.738026:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47b44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1875735413502848:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788841306.738092:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47b44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1875735413502848:12345-0@lo:38:llog_process_th.0 Request processed in 65us (799us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788841306.738099:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788841306.738215:0:3648:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788841306.738223:0:3648:0:(import.c:65:import_set_state_nolock()) ffffa04a45ff4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788841306.738227:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788841306.738231:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6d9e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875735413502848:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788841306.742007:0:22804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6d9e0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a456da20-a415-4617-896c-ee7aa5e4c089:22804:1875735413502976:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788841306.742086:0:22804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841306.745063:0:22804:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b50dc86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788841306.749571:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413502976 00000100:00100000:0.0:1788841306.749590:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413502976 00000100:00100000:0.0:1788841306.749663:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788841306.749689:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a46968450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+12:22804:x1875735413502976:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788841306.750125:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a46968450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+12:22804:x1875735413502976:12345-0@lo:502:llog_process_th.0 Request processed in 452us (8037us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841306.750144:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788841306.750212:0:22804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6d9e0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a456da20-a415-4617-896c-ee7aa5e4c089:22804:1875735413502976:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788841306.750277:0:22804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c028e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a456da20-a415-4617-896c-ee7aa5e4c089:22804:1875735413503104:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788841306.750321:0:22804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841306.750389:0:22804:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b6df380c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788841306.753430:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413503104 00000100:00100000:2.0:1788841306.753446:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413503104 00000100:00100000:2.0:1788841306.753501:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788841306.753511:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a4696a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+12:22804:x1875735413503104:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788841306.758386:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a4696a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+12:22804:x1875735413503104:12345-0@lo:502:llog_process_th.0 Request processed in 4863us (8053us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841306.758399:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788841306.758539:0:22804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c028e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a456da20-a415-4617-896c-ee7aa5e4c089:22804:1875735413503104:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788841306.758762:0:22804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788841306.759004:0:22751:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788841306.759030:0:22751:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.107@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788841306.759052:0:22751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b81b5ce00/0x5757cd208ac38115 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac3811c expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841306.759065:0:22751:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.107@tcp lock: ffffa04b81b5ce00/0x5757cd208ac38115 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac3811c expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788841306.759114:0:22751:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788841306.759116:0:22751:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788841306.759118:0:22751:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788841306.759119:0:22751:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788841306.759121:0:22751:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788841306.759122:0:22751:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788841306.759123:0:22751:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788841306.759125:0:22751:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788841306.759127:0:22751:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788841306.759128:0:22751:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788841306.759132:0:22751:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788841306.759134:0:22751:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788841306.759136:0:22751:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788841306.759137:0:22751:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788841306.759138:0:22751:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788841306.759139:0:22751:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788841306.759140:0:22751:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788841306.759141:0:22751:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788841306.759142:0:22751:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788841306.759148:0:22751:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788841306.759149:0:22751:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788841306.759171:0:22751:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788841306.759192:0:22751:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c02a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:22751:1875735413503232:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788841306.759240:0:22751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841306.759279:0:22751:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b6df38780 going to sleep for 11 seconds 00000100:00100000:1.0:1788841306.759375:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413503232 00000100:00100000:1.0:1788841306.759382:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413503232 00000100:00100000:1.0:1788841306.759429:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788841306.759438:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a4696b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+12:22751:x1875735413503232:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788841306.759464:0:22767:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788841306.759478:0:22767:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788841306.764197:0:22767:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788841306.764218:0:22767:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788841306.764582:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a4696b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+12:22751:x1875735413503232:12345-0@lo:253:mount.lustre.0 Request processed in 5141us (5338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841306.764595:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788841306.764701:0:22751:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c02a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:22751:1875735413503232:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788841306.764715:0:22751:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788841306.764719:0:22751:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788841306.764721:0:22751:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788841306.764722:0:22751:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788841306.764724:0:22751:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788841306.764725:0:22751:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788841306.764727:0:22751:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788841306.764734:0:22751:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788841306.764736:0:22751:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788841306.764738:0:22751:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788841306.764747:0:22751:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788841306.764762:0:22751:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1788841306.767870:0:22788:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788841306.767881:0:22788:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788841306.767912:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa04b7a723c00/0x5757cd208ac38131 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841306.767933:0:22788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa04a474afc00/0x5757cd208ac38100 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5757cd208ac380f9 expref: 11 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841306.767942:0:22788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa04b7a723c00/0x5757cd208ac38131 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841306.768001:0:22788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa04a474afc00/0x5757cd208ac38100 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5757cd208ac380f9 expref: 11 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841306.768015:0:22788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa04a474afc00/0x5757cd208ac38100 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5757cd208ac380f9 expref: 11 pid: 22767 timeout: 840 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841306.768031:0:22788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22788:1875735413503360:0@lo:104: 00000100:00100000:3.0:1788841306.768099:0:22788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841306.768153:0:22788:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b76037e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788841306.768292:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413503360 00000100:00100000:1.0:1788841306.768301:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413503360 00000100:00100000:1.0:1788841306.768351:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788841306.768360:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6e05f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a456da20-a415-4617-896c-ee7aa5e4c089+3:22788:x1875735413503360:12345-0@lo:104: 00010000:00010000:1.0:1788841306.768373:0:22755:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.107@tcp lock: ffffa04b7a723800/0x5757cd208ac380f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5757cd208ac38100 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841306.768438:0:22755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788841306.768445:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6e05f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a456da20-a415-4617-896c-ee7aa5e4c089+3:22788:x1875735413503360:12345-0@lo:104: Request processed in 86us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841306.768452:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788841306.768490:0:22788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22788:1875735413503360:0@lo:104: 00010000:00010000:1.0:1788841306.768511:0:22788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa04b7a723c00/0x5757cd208ac38131 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841306.768931:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788841306.768939:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.107@tcp lock: ffffa04b7a723800/0x5757cd208ac380f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5757cd208ac38100 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841306.768946:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b7a723800 already unused, calling callback (ffffffffc11a4c20) 10000000:00010000:3.0:1788841306.768951:0:22761:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.107@tcp lock: ffffa04b7a723800/0x5757cd208ac380f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5757cd208ac38100 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841306.768959:0:22761:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.107@tcp lock: ffffa04b7a723800/0x5757cd208ac380f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5757cd208ac38100 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788841306.768966:0:22761:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.107@tcp lock: ffffa04b7a723800/0x5757cd208ac380f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5757cd208ac38100 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788841306.768972:0:22761:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788841306.769013:0:22761:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.107@tcp lock: ffffa04b7a723800/0x5757cd208ac380f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5757cd208ac38100 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841306.769019:0:22761:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788841306.769045:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.107@tcp lock: ffffa04b7a723800/0x5757cd208ac380f9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5757cd208ac38100 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841306.769058:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.107@tcp lock: ffffa04b7a723800/0x5757cd208ac380f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5757cd208ac38100 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841306.769072:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841306.769074:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841306.769076:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841306.769100:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788841306.769109:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a456da20-a415-4617-896c-ee7aa5e4c089:3649:1875735413503488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788841306.769142:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841306.769286:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413503488 00000100:00100000:0.0:1788841306.769291:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413503488 00010000:00010000:0.0:1788841306.769314:0:22757:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa04a474afc00/0x5757cd208ac38100 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5757cd208ac380f9 expref: 12 pid: 22767 timeout: 840 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841306.769343:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788841306.769350:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6e05d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a456da20-a415-4617-896c-ee7aa5e4c089+12:3649:x1875735413503488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788841306.769364:0:22757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788841306.769370:0:22757:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa04a474afc00/0x5757cd208ac38100 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5757cd208ac380f9 expref: 12 pid: 22767 timeout: 840 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841306.769381:0:22757:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa04a474afc00/0x5757cd208ac38100 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5757cd208ac380f9 expref: 12 pid: 22767 timeout: 840 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841306.769394:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa04a474afc00/0x5757cd208ac38100 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5757cd208ac380f9 expref: 12 pid: 22767 timeout: 840 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841306.769407:0:22757:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa04b7a723c00/0x5757cd208ac38131 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841306.769414:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa04b7a723c00/0x5757cd208ac38131 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788841306.769428:0:22757:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001547370s 00010000:00010000:0.0:1788841306.769433:0:22757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa04b7a723c00/0x5757cd208ac38131 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841306.769445:0:22757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa04b7a723c00/0x5757cd208ac38131 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841306.769452:0:22757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa04b7a723c00/0x5757cd208ac38131 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841306.769459:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa04b7a723c00/0x5757cd208ac38131 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841306.769465:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b7a723c00 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:0.0:1788841306.769469:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa04b7a723c00/0x5757cd208ac38131 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841306.769476:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa04b7a723c00/0x5757cd208ac38131 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841306.769499:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa04b7a723c00/0x5757cd208ac38131 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841306.769509:0:22757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788841306.769543:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6e05d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a456da20-a415-4617-896c-ee7aa5e4c089+11:3649:x1875735413503488:12345-0@lo:103:ldlm_bl.0 Request processed in 194us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841306.769551:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788841306.769603:0:22788:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa04b7a723c00/0x5757cd208ac38131 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841306.769612:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa04b7a723c00/0x5757cd208ac38131 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841306.769618:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa04b7a723c00/0x5757cd208ac38131 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841306.769688:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a456da20-a415-4617-896c-ee7aa5e4c089:3649:1875735413503488:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1788841306.797804:0:22751:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:2.0:1788841306.798366:0:22751:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1788841306.798625:0:22813:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:3.0:1788841306.798969:0:22813:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1788841306.799878:0:22751:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000020:00080000:1.0:1788841306.800865:0:22812:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:1.0:1788841306.800871:0:22812:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:00080000:3.0:1788841306.802266:0:22813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788841306.802336:0:22813:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00080000:3.0:1788841306.802775:0:22814:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffffa04b6e05e300 x1875735413503616/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841306.802789:0:22814:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b429d8cc0 going to sleep for 0 seconds 00000040:01000000:0.0:1788841306.803277:0:22751:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788841306.803319:0:22751:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788841306.803820:0:22751:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788841306.803828:0:22751:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788841306.803942:0:22751:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788841306.805100:0:22751:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788841306.805643:0:22751:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788841306.806058:0:22751:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788841306.806789:0:22751:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:0.0:1788841306.807463:0:22751:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:0.0:1788841306.809649:0:22751:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:0.0:1788841306.811168:0:22751:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788841306.811205:0:22751:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbd76c190f988 00100000:10000000:0.0:1788841306.811213:0:22751:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788841306.811743:0:22751:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788841306.811760:0:22751:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.107@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788841306.811776:0:22751:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788841306.811798:0:22751:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1788841306.821522:0:22751:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788841306.821752:0:22751:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788841307.405640:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788841307.532941:0:22769:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788841307.532950:0:22769:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa04a45f80000 from 11 10000000:01000000:0.0:1788841307.532956:0:22769:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788841307.533006:0:22769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04a474ae000/0x5757cd208ac38138 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841307.533018:0:22769:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.107@tcp lock: ffffa04a474ae000/0x5757cd208ac38138 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841307.533031:0:22769:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.107@tcp lock: ffffa04a474ae000/0x5757cd208ac38138 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841307.533056:0:22769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c028a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413503744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788841307.533125:0:22769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841307.533172:0:22769:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b489116c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788841307.533263:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413503744 00000100:00100000:2.0:1788841307.533272:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413503744 00000100:00100000:2.0:1788841307.533328:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788841307.533338:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a46969450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+11:22769:x1875735413503744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788841307.533350:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841307.533365:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa04b81b5c000/0x5757cd208ac3813f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5757cd208ac38138 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841307.533387:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa04b81b5c000/0x5757cd208ac3813f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5757cd208ac38138 expref: 12 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841307.533399:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa04b81b5c000/0x5757cd208ac3813f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5757cd208ac38138 expref: 12 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841307.533407:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04b81b5c000, rc 0) 00000100:00100000:2.0:1788841307.533453:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a46969450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+12:22769:x1875735413503744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841307.533460:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788841307.533594:0:22769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c028a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413503744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788841307.533609:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.107@tcp lock: ffffa04a474ae000/0x5757cd208ac38138 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac3813f expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841307.533618:0:22769:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.107@tcp lock: ffffa04a474ae000/0x5757cd208ac38138 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5757cd208ac3813f expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841307.533693:0:22769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c028a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413503872:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788841307.533744:0:22769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841307.533766:0:22769:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b489116c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788841307.533872:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413503872 00000100:00100000:1.0:1788841307.533877:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413503872 00000100:00100000:1.0:1788841307.533910:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788841307.533917:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a4696a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+12:22769:x1875735413503872:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788841307.533932:0:22767:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788841307.533948:0:22767:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788841307.533951:0:22767:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1788841307.534028:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a4696a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+12:22769:x1875735413503872:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 111us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841307.534036:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788841307.534165:0:22769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c028a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413503872:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788841307.534206:0:22769:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.107@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788841307.534214:0:22769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04a474ae000/0x5757cd208ac38138 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac3813f expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841307.534222:0:22769:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.107@tcp lock: ffffa04a474ae000/0x5757cd208ac38138 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac3813f expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788841307.789588:0:22808:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788841307.789599:0:22808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788841307.790652:0:22808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788841307.790679:0:22808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788841307.861421:0:22814:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b429d8cc0 going to sleep for 0 seconds 00010000:00010000:2.0:1788841308.453157:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788841308.817269:0:22808:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788841308.817278:0:22808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788841308.817394:0:22808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:0.0:1788841308.817426:0:22808:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788841308.817557:0:22808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:2.0:1788841308.877106:0:22814:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b429d8cc0 going to sleep for 0 seconds 00010000:00010000:3.0:1788841309.519730:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841309.912800:0:22814:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b429d8cc0 going to sleep for 0 seconds 00010000:00010000:2.0:1788841310.541556:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841310.924921:0:22814:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b429d8cc0 going to sleep for 0 seconds 00000001:02000400:0.0:1788841311.435626:0:23057:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg407-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788841311.565197:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788841311.757982:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788841311.757989:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788841311.757993:0:37:0:(import.c:65:import_set_state_nolock()) ffffa04b7f429000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788841311.758001:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 740 00000100:00080000:3.0:1788841311.758006:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788841311.758020:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffffa04b7f429000 using connection 192.168.204.107@tcp/0@lo 00000100:00100000:3.0:1788841311.758041:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa04b6e05d180 x1875735413504128/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788841311.758063:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788841311.758066:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788841311.758070:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788841311.758073:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788841311.758075:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788841311.758078:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788841311.758080:0:37:0:(import.c:65:import_set_state_nolock()) ffffa04a45ff4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788841311.758085:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffffa04a45ff4800 using connection 192.168.204.107@tcp/0@lo 00000100:00100000:3.0:1788841311.758096:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa04b6e05ce00 x1875735413504256/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788841311.758184:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a456da20-a415-4617-896c-ee7aa5e4c089:3651:1875735413504000:0@lo:400:kworker.0 00000100:00100000:0.0:1788841311.758257:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841311.758387:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413504000 00000100:00100000:3.0:1788841311.758395:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413504000 00000100:00100000:3.0:1788841311.758443:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788841311.758452:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a4696ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+12:3651:x1875735413504000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841311.759420:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875735413504128:0@lo:38:kworker.0 00000100:00100000:2.0:1788841311.759476:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841311.759505:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875735413504256:0@lo:38:kworker.0 00000100:00100000:2.0:1788841311.759529:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841311.759724:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413504128 00000100:00100000:2.0:1788841311.759730:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413504128 00000100:00100000:2.0:1788841311.759756:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788841311.759762:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47b44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1875735413504128:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788841311.759778:0:22778:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788841311.759817:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47b44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1875735413504128:12345-0@lo:38:kworker.0 Request processed in 54us (340us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788841311.759825:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788841311.759879:0:3648:0:(import.c:65:import_set_state_nolock()) ffffa04b7f429000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788841311.759884:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788841311.759888:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875735413504128:0@lo:38:kworker.0 00000100:00100000:3.0:1788841311.760558:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a4696ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+12:3651:x1875735413504000:12345-0@lo:400:kworker.0 Request processed in 2104us (2297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841311.760567:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788841311.762739:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413504256 00000100:00100000:3.0:1788841311.762755:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413504256 00000100:00100000:3.0:1788841311.762802:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788841311.762810:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47b45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1875735413504256:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788841311.762856:0:22774:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 745 last 0 00000020:00000080:3.0:1788841311.762905:0:22774:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x5757cd208ac38146 00000004:00100000:3.0:1788841311.762923:0:22774:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788841311.763068:0:22774:0:(import.c:65:import_set_state_nolock()) ffffa04b7fa1a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788841311.763165:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47b45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875735413504256:12345-0@lo:38:kworker.0 Request processed in 354us (3634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841311.763173:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788841311.766424:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa04b6e05ce00 x1875735413504256/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788841321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788841311.766445:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788841311.766453:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788841311.766460:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788841311.766470:0:3648:0:(import.c:65:import_set_state_nolock()) ffffa04a45ff4800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788841311.766478:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875735413504256:0@lo:38:kworker.0 00000100:00100000:0.0:1788841311.768953:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a456da20-a415-4617-896c-ee7aa5e4c089:3651:1875735413504000:0@lo:400:kworker.0 00000100:00100000:0.0:1788841311.950152:0:22814:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b429d8cc0 going to sleep for 0 seconds 00000020:00000004:2.0:1788841312.419330:0:23109:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788841312.420315:0:23109:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788841312.591546:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788841312.972917:0:22814:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b429d8cc0 going to sleep for 0 seconds 00000020:00000004:1.0:1788841313.555256:0:23159:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788841313.555455:0:23159:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788841313.613726:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788841313.998793:0:22814:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b429d8cc0 going to sleep for 0 seconds 00010000:00010000:2.0:1788841314.637025:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788841315.023472:0:22814:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b429d8cc0 going to sleep for 0 seconds 00010000:00010000:3.0:1788841315.662932:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788841316.046273:0:22814:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b429d8cc0 going to sleep for 0 seconds 00010000:00010000:2.0:1788841316.684975:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841316.878782:0:3648:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788841306/real 1788841306] req@ffffa04b7c02b800 x1875735413501184/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788841316 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841316.878853:0:3648:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa04b7c02b800 x1875735413501184/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788841316 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841316.878865:0:3648:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788841306/real 1788841306] req@ffffa04b7c02bb80 x1875735413501056/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788841316 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841316.878880:0:3648:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa04b7c02bb80 x1875735413501056/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788841316 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788841316.878909:0:3648:0:(import.c:65:import_set_state_nolock()) ffffa04a47d02000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788841316.878922:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788841316.878927:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c02b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875735413501184:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788841316.878933:0:3648:0:(import.c:65:import_set_state_nolock()) ffffa04b5210f000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788841316.878938:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788841316.878941:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c02bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875735413501056:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788841316.879096:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788841316.879102:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788841316.879106:0:37:0:(import.c:65:import_set_state_nolock()) ffffa04b7f429000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788841316.879112:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 745 00000100:00080000:2.0:1788841316.879117:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788841316.879125:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffffa04b7f429000 using connection 192.168.204.107@tcp/0@lo 00000100:00100000:2.0:1788841316.879152:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa04a47b47800 x1875735413504512/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788841316.879167:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788841316.879170:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788841316.879172:0:37:0:(import.c:65:import_set_state_nolock()) ffffa04b5210f000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788841316.879175:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 740 00000100:00080000:2.0:1788841316.879177:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788841316.879181:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffffa04b5210f000 using connection 192.168.204.107@tcp/0@lo 00000100:00100000:2.0:1788841316.879193:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa04a47b45f80 x1875735413504640/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788841316.879200:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788841316.879203:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788841316.879221:0:37:0:(import.c:65:import_set_state_nolock()) ffffa04a47d02000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788841316.879225:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 740 00000100:00080000:2.0:1788841316.879228:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788841316.879232:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa04a47d02000 using connection 192.168.204.107@tcp/0@lo 00000100:00100000:2.0:1788841316.879248:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa04a47b44700 x1875735413504768/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788841316.879291:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788841316.879306:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a456da20-a415-4617-896c-ee7aa5e4c089:3651:1875735413504384:0@lo:400:kworker.0 00000100:00100000:2.0:1788841316.879396:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841316.879468:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47b47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875735413504896:0@lo:400:kworker.0 00000100:00100000:2.0:1788841316.879511:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841316.879888:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413504384 00000100:00100000:2.0:1788841316.879899:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413504384 00000100:00100000:2.0:1788841316.879961:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788841316.879972:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a4696b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+12:3651:x1875735413504384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841316.880035:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a4696b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+12:3651:x1875735413504384:12345-0@lo:400:kworker.0 Request processed in 64us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841316.880042:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788841316.880102:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413504896 00000100:00100000:2.0:1788841316.880106:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413504896 00000100:00100000:2.0:1788841316.880135:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788841316.880142:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47b47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875735413504896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841316.880178:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47b47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875735413504896:12345-0@lo:400:kworker.0 Request processed in 37us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841316.880185:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788841316.880232:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa04a47b47b80 x1875735413504896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841316.880258:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47b47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875735413504896:0@lo:400:kworker.0 00000100:00100000:2.0:1788841316.880294:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a456da20-a415-4617-896c-ee7aa5e4c089:3651:1875735413504384:0@lo:400:kworker.0 00000100:00100000:2.0:1788841316.880313:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47b47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875735413504512:0@lo:38:kworker.0 00000100:00100000:2.0:1788841316.880347:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841316.880371:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47b45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875735413504640:0@lo:8:kworker.0 00000400:00000100:2.0:1788841316.880393:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875735413504640 offset 0 length 520: 4 00000100:00100000:2.0:1788841316.880412:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47b44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875735413504768:0@lo:8:kworker.0 00000400:00000100:2.0:1788841316.880434:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875735413504768 offset 0 length 520: 4 00000100:00100000:2.0:1788841316.880460:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413504512 00000100:00100000:2.0:1788841316.880465:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413504512 00000100:00100000:2.0:1788841316.880498:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788841316.880504:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47b45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1875735413504512:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788841316.880526:0:22778:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788841316.882073:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47b45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1875735413504512:12345-0@lo:38:kworker.0 Request processed in 1554us (1712us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788841316.882089:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788841316.882203:0:3648:0:(import.c:65:import_set_state_nolock()) ffffa04b7f429000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788841316.882209:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788841316.882226:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47b47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875735413504512:0@lo:38:kworker.0 00000100:00100000:2.0:1788841317.068916:0:22814:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b429d8cc0 going to sleep for 0 seconds 00010000:00010000:3.0:1788841317.710867:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788841318.029490:0:22808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788841318.102693:0:22814:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b429d8cc0 going to sleep for 0 seconds 00010000:00010000:2.0:1788841318.733013:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788841319.118254:0:22814:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b429d8cc0 going to sleep for 0 seconds 00010000:00010000:3.0:1788841319.761636:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788841320.141659:0:22814:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b429d8cc0 going to sleep for 0 seconds 00000020:01000004:0.0:1788841320.436029:0:23505:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788841320.436035:0:23505:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788841320.436036:0:23505:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788841320.436156:0:23505:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffffa04b521ab000 00000020:01000004:0.0:1788841320.436178:0:23505:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1788841320.436189:0:23505:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788841320.436204:0:23505:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffffa04b81af99b8) 00000020:00000080:0.0:1788841320.436222:0:23505:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788841320.487344:0:23505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788841320.491531:0:23505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1788841320.492304:0:23505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788841320.492724:0:23505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1788841320.492945:0:23505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788841320.493139:0:23505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788841320.493395:0:23505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1788841320.493615:0:23505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788841320.493809:0:23505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788841320.494111:0:23505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788841320.494358:0:23505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788841320.494576:0:23505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788841320.494752:0:23505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1788841320.494956:0:23505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788841320.495432:0:23505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1788841320.496105:0:23505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788841320.496432:0:23505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1788841320.496679:0:23505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1788841320.496875:0:23505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788841320.497059:0:23505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788841320.497244:0:23505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1788841320.497438:0:23505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788841320.497678:0:23505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788841320.497947:0:23505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788841320.498133:0:23505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788841320.498313:0:23505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788841320.498501:0:23505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788841320.498756:0:23505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788841320.499134:0:23505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788841320.499346:0:23505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1788841320.499547:0:23505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788841320.499734:0:23505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1788841320.500160:0:23505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788841320.500350:0:23505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788841320.500578:0:23505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1788841320.500793:0:23505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1788841320.501097:0:23505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1788841320.501315:0:23505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788841320.501556:0:23505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788841320.501780:0:23505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1788841320.502068:0:23505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788841320.502281:0:23505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788841320.502518:0:23505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788841320.502731:0:23505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1788841320.502938:0:23505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788841320.503159:0:23505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00080000:01000000:3.0:1788841320.508600:0:23505:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788841320.508821:0:23505:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1788841320.509301:0:23505:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788841320.509386:0:23505:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5757cd208ac38154 00000020:01000004:2.0:1788841320.509395:0:23505:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788841320.509429:0:23505:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.107@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788841320.509433:0:23505:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.107@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788841320.509445:0:23505:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1788841320.509488:0:23505:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1788841320.509493:0:23505:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.107@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1788841320.520440:0:23505:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.107@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788841320.520577:0:23505:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.107@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1788841320.520583:0:23505:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788841320.520585:0:23505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788841320.520586:0:23505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788841320.520588:0:23505:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788841320.520589:0:23505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788841320.520590:0:23505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788841320.520592:0:23505:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788841320.520593:0:23505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788841320.520594:0:23505:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788841320.520598:0:23505:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1788841320.520601:0:23505:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788841320.520602:0:23505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788841320.520603:0:23505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788841320.520604:0:23505:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788841320.520605:0:23505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788841320.520607:0:23505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788841320.520608:0:23505:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788841320.520609:0:23505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788841320.520610:0:23505:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788841320.520651:0:23505:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788841320.520672:0:23505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47b47b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:23505:1875735413505024:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788841320.520743:0:23505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841320.520830:0:23505:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b76037240 going to sleep for 11 seconds 00000100:00100000:3.0:1788841320.520957:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413505024 00000100:00100000:3.0:1788841320.520965:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413505024 00000100:00100000:3.0:1788841320.521044:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788841320.521055:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a4696bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+12:23505:x1875735413505024:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788841320.521084:0:22766:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788841320.521088:0:22766:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1788841320.521095:0:22766:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788841320.521382:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a4696bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+12:23505:x1875735413505024:12345-0@lo:253:mount.lustre.0 Request processed in 328us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841320.521390:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788841320.521481:0:23505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47b47b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:23505:1875735413505024:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788841320.521493:0:23505:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788841320.521495:0:23505:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788841320.521497:0:23505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788841320.521498:0:23505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788841320.521499:0:23505:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788841320.521500:0:23505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788841320.521501:0:23505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788841320.521502:0:23505:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788841320.521503:0:23505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788841320.521504:0:23505:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788841320.521525:0:23505:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa04b521ab000 from lustre-MDT0001 10000000:01000000:0.0:1788841320.521551:0:23505:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1788841320.521554:0:23505:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788841320.521560:0:23505:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffffa04b6e03cd28 local copy 00010000:00010000:0.0:1788841320.521570:0:23505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04a474afa00/0x5757cd208ac3804a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac38051 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841320.521665:0:23505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c028a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:23505:1875735413505152:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788841320.521694:0:23505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841320.522087:0:23505:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b6e0210c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788841320.522163:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413505152 00000100:00100000:2.0:1788841320.522168:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413505152 00000100:00100000:2.0:1788841320.522194:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788841320.522201:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a4696a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+12:23505:x1875735413505152:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788841320.522279:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a4696a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+12:23505:x1875735413505152:12345-0@lo:501:mount.lustre.0 Request processed in 78us (584us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788841320.522296:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788841320.522363:0:23505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c028a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:23505:1875735413505152:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788841320.522378:0:23505:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.107@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788841320.522397:0:23505:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.107@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788841320.522404:0:23505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04a474afa00/0x5757cd208ac3804a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac38051 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841320.522436:0:23505:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.107@tcp lock: ffffa04a474afa00/0x5757cd208ac3804a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac38051 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788841320.522463:0:23505:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa04b521ab000 10000000:01000000:0.0:1788841320.522469:0:23505:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788841320.522474:0:23505:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffffa04b6e03cd28 10000000:01000000:0.0:1788841320.522485:0:23505:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788841320.522490:0:23505:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffffa04b6e03cd28 from 1 10000000:01000000:0.0:1788841320.522493:0:23505:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788841320.522518:0:23505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04a474afe00/0x5757cd208ac3815b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841320.522526:0:23505:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.107@tcp lock: ffffa04a474afe00/0x5757cd208ac3815b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841320.522535:0:23505:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.107@tcp lock: ffffa04a474afe00/0x5757cd208ac3815b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841320.522549:0:23505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c028a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:23505:1875735413505280:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788841320.522576:0:23505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841320.522597:0:23505:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b6e0210c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788841320.522688:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413505280 00000100:00100000:2.0:1788841320.522692:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413505280 00000100:00100000:2.0:1788841320.522711:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788841320.522717:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a46968c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+12:23505:x1875735413505280:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788841320.522725:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841320.522738:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa04b81b5d000/0x5757cd208ac38162 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5757cd208ac3815b expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841320.522758:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa04b81b5d000/0x5757cd208ac38162 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5757cd208ac3815b expref: 13 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841320.522767:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa04b81b5d000/0x5757cd208ac38162 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5757cd208ac3815b expref: 13 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841320.522776:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04b81b5d000, rc 0) 00000100:00100000:2.0:1788841320.522811:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a46968c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+13:23505:x1875735413505280:12345-0@lo:101:mount.lustre.0 Request processed in 94us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841320.522817:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788841320.522919:0:23505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c028a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:23505:1875735413505280:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788841320.522931:0:23505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.107@tcp lock: ffffa04a474afe00/0x5757cd208ac3815b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac38162 expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841320.522940:0:23505:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.107@tcp lock: ffffa04a474afe00/0x5757cd208ac3815b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5757cd208ac38162 expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788841320.522965:0:23505:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.107@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788841320.522973:0:23505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04a474afe00/0x5757cd208ac3815b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac38162 expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841320.522980:0:23505:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.107@tcp lock: ffffa04a474afe00/0x5757cd208ac3815b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac38162 expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788841320.522986:0:23505:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffffa04b521ab000 10000000:01000000:0.0:1788841320.522990:0:23505:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788841320.522993:0:23505:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffffa04b521ab000 from 1 10000000:01000000:0.0:1788841320.522995:0:23505:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788841320.523009:0:23505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04a474aec00/0x5757cd208ac38169 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841320.523016:0:23505:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.107@tcp lock: ffffa04a474aec00/0x5757cd208ac38169 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841320.523023:0:23505:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.107@tcp lock: ffffa04a474aec00/0x5757cd208ac38169 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841320.523035:0:23505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c028a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:23505:1875735413505408:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788841320.523058:0:23505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841320.523075:0:23505:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b6e0210c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788841320.523138:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413505408 00000100:00100000:2.0:1788841320.523142:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413505408 00000100:00100000:2.0:1788841320.523161:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788841320.523166:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a46969050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+13:23505:x1875735413505408:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788841320.523172:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841320.523180:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa04b81b5da00/0x5757cd208ac38170 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5757cd208ac38169 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841320.523192:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa04b81b5da00/0x5757cd208ac38170 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5757cd208ac38169 expref: 14 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841320.523209:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa04b81b5da00/0x5757cd208ac38170 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5757cd208ac38169 expref: 14 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841320.523215:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04b81b5da00, rc 0) 00000100:00100000:2.0:1788841320.523249:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a46969050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+14:23505:x1875735413505408:12345-0@lo:101:mount.lustre.0 Request processed in 83us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841320.523255:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788841320.523322:0:23505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c028a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:23505:1875735413505408:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788841320.523332:0:23505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.107@tcp lock: ffffa04a474aec00/0x5757cd208ac38169 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac38170 expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841320.523340:0:23505:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.107@tcp lock: ffffa04a474aec00/0x5757cd208ac38169 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5757cd208ac38170 expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788841320.523357:0:23505:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.107@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788841320.523372:0:23505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04a474aec00/0x5757cd208ac38169 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac38170 expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841320.523378:0:23505:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.107@tcp lock: ffffa04a474aec00/0x5757cd208ac38169 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac38170 expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788841320.523384:0:23505:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788841320.523387:0:23505:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788841320.523391:0:23505:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffffa04b521ab000 10000000:01000000:0.0:1788841320.523394:0:23505:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788841320.523396:0:23505:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1788841320.523398:0:23505:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788841320.523421:0:23505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04a474af600/0x5757cd208ac38177 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841320.523428:0:23505:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.107@tcp lock: ffffa04a474af600/0x5757cd208ac38177 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841320.523435:0:23505:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.107@tcp lock: ffffa04a474af600/0x5757cd208ac38177 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841320.523446:0:23505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c028a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:23505:1875735413505536:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788841320.523472:0:23505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841320.523496:0:23505:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b6e0210c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788841320.523597:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413505536 00000100:00100000:2.0:1788841320.523601:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413505536 00000100:00100000:2.0:1788841320.523619:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788841320.523625:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a4696b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+14:23505:x1875735413505536:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788841320.523632:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841320.523640:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa04b81b5c800/0x5757cd208ac3817e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5757cd208ac38177 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841320.523652:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa04b81b5c800/0x5757cd208ac3817e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5757cd208ac38177 expref: 15 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841320.523660:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa04b81b5c800/0x5757cd208ac3817e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5757cd208ac38177 expref: 15 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841320.523666:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04b81b5c800, rc 0) 00000100:00100000:2.0:1788841320.523704:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a4696b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+15:23505:x1875735413505536:12345-0@lo:101:mount.lustre.0 Request processed in 78us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841320.523710:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788841320.523772:0:23505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c028a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:23505:1875735413505536:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788841320.523781:0:23505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.107@tcp lock: ffffa04a474af600/0x5757cd208ac38177 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac3817e expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841320.523794:0:23505:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.107@tcp lock: ffffa04a474af600/0x5757cd208ac38177 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5757cd208ac3817e expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788841320.527638:0:23505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:0.0:1788841320.528706:0:23505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788841320.532724:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1788841320.532790:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:1.0:1788841320.532806:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:1.0:1788841320.532817:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:1.0:1788841320.532829:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:1.0:1788841320.533004:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:1.0:1788841320.533017:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:1.0:1788841320.533030:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:1.0:1788841320.533041:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:1.0:1788841320.533052:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:1.0:1788841320.533063:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:1.0:1788841320.533076:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:1.0:1788841320.533089:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:1.0:1788841320.533100:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:1.0:1788841320.533111:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:1.0:1788841320.533121:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:1.0:1788841320.533132:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:1.0:1788841320.533144:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:1.0:1788841320.533156:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:1.0:1788841320.533167:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:1.0:1788841320.533179:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:1.0:1788841320.533192:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:1.0:1788841320.533203:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:1.0:1788841320.533219:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:1.0:1788841320.533233:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:1.0:1788841320.533246:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:1.0:1788841320.533259:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:1.0:1788841320.533272:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:1.0:1788841320.533286:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:1.0:1788841320.533299:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:1.0:1788841320.533312:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:1.0:1788841320.533325:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:1.0:1788841320.533339:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:1.0:1788841320.533351:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:1.0:1788841320.533377:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:1.0:1788841320.533392:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:1.0:1788841320.533419:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:1.0:1788841320.533436:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:1.0:1788841320.533450:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:1.0:1788841320.533462:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:1.0:1788841320.533558:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:1.0:1788841320.533577:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:1.0:1788841320.533590:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:1.0:1788841320.533604:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:1.0:1788841320.533631:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:1.0:1788841320.533637:0:23505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:1.0:1788841320.533750:0:23505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6d9e1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:23505:1875735413505664:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788841320.533817:0:23505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841320.534017:0:23505:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b4893d240 going to sleep for 11 seconds 00000100:00100000:2.0:1788841320.534065:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413505664 00000100:00100000:2.0:1788841320.534074:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413505664 00000100:00100000:2.0:1788841320.534167:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788841320.534177:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a46968850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+15:23505:x1875735413505664:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788841320.534317:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a46968850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+15:23505:x1875735413505664:12345-0@lo:501:mount.lustre.0 Request processed in 141us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841320.534324:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788841320.534398:0:23505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6d9e1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:23505:1875735413505664:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788841320.534444:0:23505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6d9e1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:23505:1875735413505792:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788841320.534493:0:23505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841320.534620:0:23505:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b4893d240 going to sleep for 11 seconds 00000100:00100000:0.0:1788841320.534688:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413505792 00000100:00100000:0.0:1788841320.534693:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413505792 00000100:00100000:0.0:1788841320.534716:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788841320.534723:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7060d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+15:23505:x1875735413505792:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788841320.535338:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7060d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+15:23505:x1875735413505792:12345-0@lo:503:mount.lustre.0 Request processed in 614us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841320.535345:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788841320.535438:0:23505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6d9e1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:23505:1875735413505792:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788841320.535868:0:23505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788841320.535929:0:23505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6d9e1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:23505:1875735413505920:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788841320.535967:0:23505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841320.535995:0:23505:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b4893d240 going to sleep for 11 seconds 00000100:00100000:0.0:1788841320.536103:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413505920 00000100:00100000:0.0:1788841320.536109:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413505920 00000100:00100000:0.0:1788841320.536136:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788841320.536143:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7060e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+15:23505:x1875735413505920:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788841320.536686:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7060e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+15:23505:x1875735413505920:12345-0@lo:502:mount.lustre.0 Request processed in 541us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841320.536693:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788841320.536770:0:23505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6d9e1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:23505:1875735413505920:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788841320.537036:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1788841320.537063:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:1.0:1788841320.537087:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:1.0:1788841320.537099:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:1.0:1788841320.537113:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:1.0:1788841320.537125:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:1.0:1788841320.537136:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:1.0:1788841320.537147:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:1.0:1788841320.537158:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:1.0:1788841320.537183:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:1.0:1788841320.537196:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:1.0:1788841320.537207:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:1.0:1788841320.537218:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:1.0:1788841320.537230:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:1.0:1788841320.537243:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:1.0:1788841320.537255:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:1.0:1788841320.537269:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:1.0:1788841320.537283:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:1.0:1788841320.537296:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:1.0:1788841320.537309:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:1.0:1788841320.537323:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:1.0:1788841320.537334:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:1.0:1788841320.537347:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:1.0:1788841320.537359:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:1.0:1788841320.537370:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:1.0:1788841320.537394:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:1.0:1788841320.537421:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:1.0:1788841320.537437:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:1.0:1788841320.537448:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:1.0:1788841320.537458:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:1.0:1788841320.537468:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:1.0:1788841320.537604:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:1.0:1788841320.537622:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:1.0:1788841320.537635:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:1.0:1788841320.537645:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:1.0:1788841320.537669:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:1.0:1788841320.537681:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:1.0:1788841320.537692:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:1.0:1788841320.537703:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:1.0:1788841320.537716:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:1.0:1788841320.537727:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:1.0:1788841320.537753:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:1.0:1788841320.537768:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:1.0:1788841320.537780:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:1.0:1788841320.537809:0:23505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6d9e1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:23505:1875735413506048:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788841320.537888:0:23505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841320.537913:0:23505:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b4893d240 going to sleep for 11 seconds 00000100:00100000:0.0:1788841320.537984:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413506048 00000100:00100000:0.0:1788841320.537989:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413506048 00000100:00100000:0.0:1788841320.538019:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788841320.538028:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7060cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+15:23505:x1875735413506048:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788841320.538122:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7060cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+15:23505:x1875735413506048:12345-0@lo:502:mount.lustre.0 Request processed in 95us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841320.538130:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788841320.538318:0:23505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6d9e1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:23505:1875735413506048:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788841320.538357:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:1.0:1788841320.538364:0:23505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1788841320.539044:0:23509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788841320.539057:0:23509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788841320.539059:0:23509:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788841320.539065:0:23509:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1788841320.539068:0:23509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788841320.539083:0:23509:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffffa04b7f77b370) 00000020:00000080:1.0:1788841320.539103:0:23509:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1788841320.539108:0:23509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788841320.539174:0:23509:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788841320.539180:0:23509:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5757cd208ac3818c 00000020:00000080:1.0:1788841320.539360:0:23509:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788841320.539364:0:23509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788841320.539367:0:23509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788841320.539368:0:23509:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788841320.539371:0:23509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788841320.539374:0:23509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788841320.539381:0:23509:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1788841320.539385:0:23509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788841320.539392:0:23509:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffffa04b7f77cd28) 00000020:00000080:1.0:1788841320.539402:0:23509:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1788841320.539405:0:23509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788841320.539419:0:23509:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1788841320.539422:0:23509:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1788841320.539429:0:23509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788841320.539551:0:23509:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa04b521ab000 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1788841320.539564:0:23509:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffffa04b7f778000) 00000020:00000080:1.0:1788841320.539575:0:23509:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1788841320.539631:0:23509:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788841320.539636:0:23509:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5757cd208ac381a1 00000020:00000080:1.0:1788841320.539729:0:23509:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1788841320.539736:0:23509:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788841320.539741:0:23509:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x5757cd208ac381a8 00080000:01000000:1.0:1788841320.539746:0:23509:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788841320.539750:0:23509:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5757cd208ac381af 00010000:00010000:0.0:1788841320.631145:0:23509:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:0.0:1788841320.631685:0:23509:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:0.0:1788841320.631999:0:23509:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788841320.637532:0:23509:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1788841320.637550:0:23509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788841320.637557:0:23509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788841320.637559:0:23509:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1788841320.637563:0:23509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788841320.637571:0:23509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788841320.637573:0:23509:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1788841320.637576:0:23509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788841320.637582:0:23509:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.107@tcp to nid 0x20000c0a8cc6b (192.168.204.107@tcp) 00000020:00000080:1.0:1788841320.637614:0:23509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788841320.637631:0:23509:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffffa04b7f7799b8) 00000020:00000080:1.0:1788841320.637656:0:23509:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1788841320.637661:0:23509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788841320.637749:0:23509:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1788841320.637755:0:23509:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788841320.637768:0:23509:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5757cd208ac381bd 00010000:00080000:1.0:1788841320.637809:0:23509:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa04b527e4000@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.107@tcp at head 00010000:00010000:1.0:1788841320.640396:0:23509:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1788841320.644263:0:23509:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788841320.644280:0:23509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788841320.644323:0:23509:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788841320.644348:0:23509:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5757cd208ac381c4 00000100:00080000:3.0:1788841320.644360:0:23509:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788841320.644368:0:23509:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffffa04b527e4000 using connection 192.168.204.107@tcp/0@lo 00000100:00100000:3.0:1788841320.644426:0:23509:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa04b6e05f480 x1875735413506176/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788841320.644456:0:23509:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1788841320.644525:0:23509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788841320.644530:0:23509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788841320.644532:0:23509:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1788841320.644535:0:23509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788841320.644537:0:23509:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1788841320.644539:0:23509:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788841320.644540:0:23509:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788841320.644542:0:23509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788841320.644545:0:23509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788841320.644546:0:23509:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788841320.644558:0:23509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788841320.644563:0:23509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788841320.644565:0:23509:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1788841320.644569:0:23509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788841320.644603:0:23509:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788841320.644618:0:23509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788841320.644621:0:23509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788841320.644623:0:23509:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1788841320.644625:0:23509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788841320.644627:0:23509:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:3.0:1788841320.644628:0:23509:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788841320.644630:0:23509:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788841320.644632:0:23509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788841320.644634:0:23509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788841320.644636:0:23509:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788841320.644638:0:23509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788841320.644641:0:23509:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788841320.644645:0:23509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788841320.644646:0:23509:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788841320.644649:0:23509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788841320.644653:0:23509:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.107@tcp to nid 0x20000c0a8cc6b (192.168.204.107@tcp) 00000020:01000000:3.0:1788841320.644677:0:23509:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788841320.644680:0:23509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788841320.644694:0:23509:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffffa04b527d4d28) 00000020:00000080:3.0:1788841320.644707:0:23509:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1788841320.644712:0:23509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788841320.644771:0:23509:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1788841320.644778:0:23509:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788841320.644784:0:23509:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5757cd208ac381d2 00010000:00080000:3.0:1788841320.644815:0:23509:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa04b7cf0c800@lustre-OST0000-osc-MDT0001: add connection 192.168.204.107@tcp at head 00010000:00010000:3.0:1788841320.645062:0:23509:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:3.0:1788841320.645303:0:11140:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788841320.645312:0:11140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788841320.645315:0:11140:0:(import.c:65:import_set_state_nolock()) ffffa04b7f429000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788841320.645320:0:11140:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 751 00000100:00080000:3.0:1788841320.645325:0:11140:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788841320.645329:0:11140:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffffa04b7f429000 using connection 192.168.204.107@tcp/0@lo 00000100:00100000:3.0:1788841320.645359:0:11140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa04b6e05df80 x1875735413506304/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788841320.645371:0:11140:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788841320.645374:0:11140:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788841320.645377:0:11140:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788841320.645380:0:11140:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788841320.645726:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875735413506176:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788841320.645801:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841320.645865:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875735413506304:0@lo:38:kworker.0 00000100:00100000:0.0:1788841320.645887:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841320.646263:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875735413506432:0@lo:400:kworker.0 00000100:00100000:2.0:1788841320.646300:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841320.646396:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413506176 00000100:00100000:2.0:1788841320.646403:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413506176 00000100:00100000:2.0:1788841320.646436:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413506304 00000100:00100000:2.0:1788841320.646438:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413506304 00000100:00100000:2.0:1788841320.646450:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788841320.646457:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7c028a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1875735413506176:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788841320.646490:0:22778:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 754 last 0 00000020:00000080:2.0:1788841320.646539:0:22778:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5757cd208ac381d9 00000004:00100000:2.0:1788841320.646558:0:22778:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788841320.646565:0:22778:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000040:01000000:3.0:1788841320.648114:0:23509:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788841320.650736:0:23509:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1788841320.652636:0:23509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788841320.653760:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:3.0:1788841320.653969:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:0.0:1788841320.654150:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413506432 00000100:00100000:0.0:1788841320.654170:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413506432 00000100:00100000:0.0:1788841320.654235:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788841320.654247:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47b46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875735413506432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841320.654350:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47b46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875735413506432:12345-0@lo:400:kworker.0 Request processed in 105us (8049us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841320.654357:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788841320.654631:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa04b6e05dc00 x1875735413506432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841320.654646:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875735413506432:0@lo:400:kworker.0 00000100:00080000:2.0:1788841320.655764:0:22778:0:(import.c:65:import_set_state_nolock()) ffffa04b4851d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788841320.655869:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7c028a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3648:x1875735413506176:12345-0@lo:38:llog_process_th.0 Request processed in 9410us (10067us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841320.655879:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788841320.655901:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788841320.655907:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7c028700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1875735413506304:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788841320.655960:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7c028700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1875735413506304:12345-0@lo:38:kworker.0 Request processed in 52us (10071us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788841320.655967:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788841320.656108:0:3648:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788841320.656118:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1788841320.656127:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788841320.656132:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788841320.656135:0:3648:0:(import.c:65:import_set_state_nolock()) ffffa04b527e4000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788841320.656155:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875735413506176:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788841320.656288:0:3648:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788841320.656294:0:3648:0:(import.c:65:import_set_state_nolock()) ffffa04b7f429000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788841320.656299:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788841320.656302:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875735413506304:0@lo:38:kworker.0 00000100:00100000:3.0:1788841320.656630:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6d9e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875735413506560:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788841320.656674:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841320.656825:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413506560 00000100:00100000:0.0:1788841320.656868:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413506560 00000100:00100000:0.0:1788841320.656908:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788841320.656917:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6e05df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3651:x1875735413506560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788841320.656945:0:22777:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788841320.656985:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6e05df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3651:x1875735413506560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841320.656992:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000040:00080000:2.0:1788841320.657110:0:23514:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788841320.657115:0:23514:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000100:00100000:3.0:1788841320.657397:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6d9e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875735413506560:0@lo:41:osp-pre-0-1.0 00000020:00000080:1.0:1788841320.659963:0:23509:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788841320.659979:0:23509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788841320.660027:0:23509:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788841320.660048:0:23509:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5757cd208ac381e0 00000100:00080000:1.0:1788841320.660057:0:23509:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788841320.660063:0:23509:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffffa04b7cf0c800 using connection 192.168.204.107@tcp/0@lo 00000100:00100000:1.0:1788841320.660149:0:23509:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa04b6d9e1c00 x1875735413506688/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788841320.660320:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6d9e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875735413506688:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788841320.660375:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875735413506688 offset 0 length 520: 4 00000100:00080000:1.0:1788841320.660438:0:23509:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788841320.660544:0:23509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788841320.660548:0:23509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788841320.660550:0:23509:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788841320.660553:0:23509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788841320.660555:0:23509:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1788841320.660557:0:23509:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788841320.660559:0:23509:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788841320.660561:0:23509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788841320.660563:0:23509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788841320.660564:0:23509:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788841320.660566:0:23509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788841320.660570:0:23509:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788841320.660573:0:23509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788841320.660574:0:23509:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788841320.660577:0:23509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788841320.660580:0:23509:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.107@tcp to nid 0x20000c0a8cc6b (192.168.204.107@tcp) 00000020:01000000:1.0:1788841320.660598:0:23509:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788841320.660607:0:23509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788841320.660618:0:23509:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffffa04b6e053370) 00000020:00000080:1.0:1788841320.660631:0:23509:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1788841320.660635:0:23509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788841320.660700:0:23509:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1788841320.660706:0:23509:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788841320.660712:0:23509:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5757cd208ac381ee 00010000:00080000:1.0:1788841320.660737:0:23509:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa04b7cea3800@lustre-OST0001-osc-MDT0001: add connection 192.168.204.107@tcp at head 00010000:00010000:1.0:1788841320.660953:0:23509:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1788841320.661017:0:23509:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788841320.661030:0:23509:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:2.0:1788841320.661827:0:11140:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788841320.661844:0:11140:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788841320.661847:0:11140:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788841320.661850:0:11140:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1788841320.664567:0:23509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788841320.667429:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1788841320.667604:0:23509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:1.0:1788841320.668420:0:23516:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788841320.668425:0:23516:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788841320.671875:0:23509:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788841320.671893:0:23509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788841320.671941:0:23509:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788841320.671965:0:23509:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5757cd208ac381f5 00000100:00080000:3.0:1788841320.671975:0:23509:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788841320.671981:0:23509:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffffa04b7cea3800 using connection 192.168.204.107@tcp/0@lo 00000100:00100000:3.0:1788841320.672019:0:23509:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa04b6e05f480 x1875735413506816/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788841320.672045:0:23509:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1788841320.672077:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875735413506816:0@lo:8:llog_process_th.0 00000020:01000000:3.0:1788841320.672106:0:23509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788841320.672109:0:23509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788841320.672111:0:23509:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788841320.672113:0:23509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788841320.672117:0:23509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788841320.672118:0:23509:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788841320.672120:0:23509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788841320.672122:0:23509:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788841320.672124:0:23509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788841320.672126:0:23509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788841320.672128:0:23509:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788841320.672130:0:23509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000400:00000100:0.0:1788841320.672131:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875735413506816 offset 0 length 520: 4 00000020:00000080:3.0:1788841320.672132:0:23509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788841320.672133:0:23509:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788841320.672143:0:23509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788841320.672191:0:23509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788841320.672194:0:23509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788841320.672195:0:23509:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788841320.672199:0:23509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000020:01000000:1.0:1788841320.672262:0:23505:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:1.0:1788841320.672296:0:23505:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.107@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788841320.672321:0:23505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04a474af600/0x5757cd208ac38177 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac3817e expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841320.672332:0:23505:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.107@tcp lock: ffffa04a474af600/0x5757cd208ac38177 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac3817e expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788841320.672341:0:23505:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa04b521ab000 from 1 10000000:01000000:1.0:1788841320.672343:0:23505:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788841320.672369:0:23505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b48dc6200/0x5757cd208ac381fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841320.672378:0:23505:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.107@tcp lock: ffffa04b48dc6200/0x5757cd208ac381fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841320.672399:0:23505:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.107@tcp lock: ffffa04b48dc6200/0x5757cd208ac381fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841320.672428:0:23505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6d9e1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:23505:1875735413506944:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788841320.672467:0:23505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788841320.672561:0:11140:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788841320.672565:0:11140:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788841320.672568:0:11140:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788841320.672570:0:11140:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788841320.672624:0:23505:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b48911f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788841320.675505:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413506944 00000100:00100000:2.0:1788841320.675523:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413506944 00000100:00100000:2.0:1788841320.675606:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788841320.675616:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7060c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+15:23505:x1875735413506944:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788841320.675633:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841320.675656:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa04b81b5d800/0x5757cd208ac38203 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5757cd208ac381fc expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841320.675688:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa04b81b5d800/0x5757cd208ac38203 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5757cd208ac381fc expref: 16 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841320.675700:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa04b81b5d800/0x5757cd208ac38203 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5757cd208ac381fc expref: 16 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841320.675726:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04b81b5d800, rc 0) 00000100:00100000:2.0:1788841320.675815:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7060c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+16:23505:x1875735413506944:12345-0@lo:101:mount.lustre.0 Request processed in 200us (3347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841320.675821:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788841320.675857:0:23505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6d9e1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:23505:1875735413506944:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788841320.675879:0:23505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.107@tcp lock: ffffa04b48dc6200/0x5757cd208ac381fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac38203 expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841320.675890:0:23505:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.107@tcp lock: ffffa04b48dc6200/0x5757cd208ac381fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5757cd208ac38203 expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841320.676764:0:23505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6d9e1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:23505:1875735413507072:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788841320.676817:0:23505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841320.676880:0:23505:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b48911f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788841320.677199:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413507072 00000100:00100000:3.0:1788841320.677205:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413507072 00000100:00100000:3.0:1788841320.677302:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788841320.677311:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7060c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+16:23505:x1875735413507072:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788841320.677329:0:22767:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788841320.677347:0:22767:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788841320.677351:0:22767:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:3.0:1788841320.677460:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7060c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+16:23505:x1875735413507072:12345-0@lo:256:mount.lustre.0 Request processed in 150us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841320.677468:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788841320.677549:0:23505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6d9e1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:23505:1875735413507072:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788841320.678187:0:23505:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.107@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788841320.678210:0:23505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b48dc6200/0x5757cd208ac381fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac38203 expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841320.678222:0:23505:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.107@tcp lock: ffffa04b48dc6200/0x5757cd208ac381fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac38203 expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788841320.678230:0:23505:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa04b521ab000 from 1 10000000:01000000:1.0:1788841320.678233:0:23505:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788841320.678267:0:23505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b48dc7400/0x5757cd208ac3820a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841320.678275:0:23505:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.107@tcp lock: ffffa04b48dc7400/0x5757cd208ac3820a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841320.678283:0:23505:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.107@tcp lock: ffffa04b48dc7400/0x5757cd208ac3820a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841320.678299:0:23505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6d9e1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:23505:1875735413507200:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788841320.678335:0:23505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841320.682721:0:23505:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b48911f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788841320.682776:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413507200 00000100:00100000:0.0:1788841320.682786:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413507200 00000100:00100000:0.0:1788841320.682907:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788841320.682918:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7060e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+16:23505:x1875735413507200:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788841320.682932:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841320.682950:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa04a474aee00/0x5757cd208ac38211 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5757cd208ac3820a expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841320.682977:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa04a474aee00/0x5757cd208ac38211 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5757cd208ac3820a expref: 17 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841320.682988:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa04a474aee00/0x5757cd208ac38211 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5757cd208ac3820a expref: 17 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841320.682996:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04a474aee00, rc 0) 00000100:00100000:0.0:1788841320.683105:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7060e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+17:23505:x1875735413507200:12345-0@lo:101:mount.lustre.0 Request processed in 188us (4767us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841320.683112:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788841320.683264:0:23505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6d9e1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:23505:1875735413507200:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788841320.683281:0:23505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.107@tcp lock: ffffa04b48dc7400/0x5757cd208ac3820a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac38211 expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841320.683291:0:23505:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.107@tcp lock: ffffa04b48dc7400/0x5757cd208ac3820a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5757cd208ac38211 expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788841320.684340:0:23505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:1.0:1788841320.684692:0:23505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788841320.684940:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1788841320.684964:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:1.0:1788841320.684977:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:1.0:1788841320.684991:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:1.0:1788841320.685004:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:1.0:1788841320.685019:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:1.0:1788841320.685047:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:1.0:1788841320.685062:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:1.0:1788841320.685073:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1788841320.685084:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:1.0:1788841320.685107:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:1.0:1788841320.685125:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:1.0:1788841320.685130:0:23505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:1.0:1788841320.685206:0:23505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6d9e1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:23505:1875735413507328:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788841320.685265:0:23505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841320.685367:0:23505:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b48911cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788841320.685430:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413507328 00000100:00100000:0.0:1788841320.685438:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413507328 00000100:00100000:0.0:1788841320.685576:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788841320.685587:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7060c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+17:23505:x1875735413507328:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788841320.685693:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7060c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+17:23505:x1875735413507328:12345-0@lo:501:mount.lustre.0 Request processed in 108us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841320.685700:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788841320.685772:0:23505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6d9e1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:23505:1875735413507328:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788841320.685804:0:23505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6d9e1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:23505:1875735413507456:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788841320.685865:0:23505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841320.685974:0:23505:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b48911cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788841320.686011:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413507456 00000100:00100000:3.0:1788841320.686016:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413507456 00000100:00100000:3.0:1788841320.686037:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788841320.686043:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7060f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+17:23505:x1875735413507456:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788841320.686158:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7060f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+17:23505:x1875735413507456:12345-0@lo:503:mount.lustre.0 Request processed in 114us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841320.686165:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788841320.686238:0:23505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6d9e1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:23505:1875735413507456:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788841320.686628:0:23505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788841320.686677:0:23505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6d9e1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:23505:1875735413507584:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788841320.686708:0:23505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841320.686768:0:23505:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b48911f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788841320.686797:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413507584 00000100:00100000:3.0:1788841320.686801:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413507584 00000100:00100000:3.0:1788841320.686915:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788841320.686923:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7060d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+17:23505:x1875735413507584:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788841320.686985:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7060d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+17:23505:x1875735413507584:12345-0@lo:502:mount.lustre.0 Request processed in 63us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841320.686999:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788841320.687059:0:23505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6d9e1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:23505:1875735413507584:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788841320.687228:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1788841320.687253:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:1.0:1788841320.687268:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:1.0:1788841320.687282:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:1.0:1788841320.687296:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:1.0:1788841320.687310:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:1.0:1788841320.687324:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:1.0:1788841320.687339:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:1.0:1788841320.687370:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1788841320.687386:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:1.0:1788841320.687399:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:1.0:1788841320.687439:0:23505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6d9e1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:23505:1875735413507712:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788841320.687485:0:23505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841320.687657:0:23505:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b48911f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788841320.687659:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413507712 00000100:00100000:2.0:1788841320.687665:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413507712 00000100:00100000:2.0:1788841320.687714:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788841320.687722:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7060ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+17:23505:x1875735413507712:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788841320.687828:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7060ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+17:23505:x1875735413507712:12345-0@lo:502:mount.lustre.0 Request processed in 106us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841320.687874:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788841320.689303:0:23505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6d9e1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:23505:1875735413507712:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788841320.689402:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:1.0:1788841320.689425:0:23505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788841320.693322:0:23518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788841320.693336:0:23518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788841320.693338:0:23518:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788841320.693346:0:23518:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa04b521ab000 00000020:00000080:1.0:1788841320.693348:0:23518:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788841320.693356:0:23518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788841320.693359:0:23518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788841320.693360:0:23518:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788841320.693362:0:23518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788841320.693364:0:23518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788841320.693366:0:23518:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788841320.693369:0:23518:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa04b521ab000 00000020:00000080:1.0:1788841320.693371:0:23518:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788841320.693715:0:23518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788841320.693719:0:23518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788841320.693720:0:23518:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788841320.693723:0:23518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788841320.693725:0:23518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788841320.693726:0:23518:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788841320.693730:0:23518:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa04b521ab000 00000020:00000080:1.0:1788841320.693732:0:23518:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788841320.696388:0:23518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788841320.696400:0:23518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788841320.696402:0:23518:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788841320.696417:0:23518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788841320.696437:0:23518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788841320.696439:0:23518:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788841320.696445:0:23518:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa04b521ab000 00000020:00000080:1.0:1788841320.696447:0:23518:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788841320.696518:0:23518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788841320.696522:0:23518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788841320.696523:0:23518:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788841320.696526:0:23518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:2.0:1788841320.706606:0:23505:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788841320.706658:0:23505:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.107@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788841320.706687:0:23505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b48dc7400/0x5757cd208ac3820a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac38211 expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841320.706701:0:23505:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.107@tcp lock: ffffa04b48dc7400/0x5757cd208ac3820a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac38211 expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788841320.706912:0:23505:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788841320.706915:0:23505:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa04b521ab000 10000000:01000000:2.0:1788841320.706918:0:23505:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa04b521ab000 10000000:01000000:2.0:1788841320.706922:0:23505:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788841320.706928:0:23505:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa04b521ab000 from 1 10000000:01000000:2.0:1788841320.706931:0:23505:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788841320.706967:0:23505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b81b5d200/0x5757cd208ac38218 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841320.706986:0:23505:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.107@tcp lock: ffffa04b81b5d200/0x5757cd208ac38218 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841320.706996:0:23505:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.107@tcp lock: ffffa04b81b5d200/0x5757cd208ac38218 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841320.707020:0:23505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47b45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:23505:1875735413507840:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788841320.707088:0:23505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841320.707128:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413507840 00000100:00100000:2.0:1788841320.707134:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413507840 00000100:00100000:2.0:1788841320.707362:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788841320.707375:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7060f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+17:23505:x1875735413507840:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788841320.707390:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841320.707414:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa04b81b5d600/0x5757cd208ac3821f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5757cd208ac38218 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841320.707439:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa04b81b5d600/0x5757cd208ac3821f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5757cd208ac38218 expref: 18 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841320.707449:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa04b81b5d600/0x5757cd208ac3821f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5757cd208ac38218 expref: 18 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841320.707457:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04b81b5d600, rc 0) 00000100:00100000:2.0:1788841320.707492:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7060f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+18:23505:x1875735413507840:12345-0@lo:101:mount.lustre.0 Request processed in 119us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841320.707498:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788841320.707548:0:23505:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b43383c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788841320.707577:0:23505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47b45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:23505:1875735413507840:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788841320.707592:0:23505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.107@tcp lock: ffffa04b81b5d200/0x5757cd208ac38218 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac3821f expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841320.707600:0:23505:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.107@tcp lock: ffffa04b81b5d200/0x5757cd208ac38218 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5757cd208ac3821f expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788841320.710145:0:23505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:2.0:1788841320.710682:0:23505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788841320.712383:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:2.0:1788841320.712449:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:2.0:1788841320.712465:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:2.0:1788841320.713384:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:2.0:1788841320.713416:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:2.0:1788841320.713431:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:2.0:1788841320.713442:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:2.0:1788841320.713453:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:2.0:1788841320.713464:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:2.0:1788841320.713576:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:2.0:1788841320.713594:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:2.0:1788841320.713624:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:2.0:1788841320.713636:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:2.0:1788841320.713647:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:2.0:1788841320.713659:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:2.0:1788841320.713669:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:2.0:1788841320.713680:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:2.0:1788841320.713691:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:2.0:1788841320.713702:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:2.0:1788841320.713713:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:2.0:1788841320.713724:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:2.0:1788841320.713735:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:2.0:1788841320.713754:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:2.0:1788841320.713766:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:2.0:1788841320.713777:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:2.0:1788841320.713788:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:2.0:1788841320.713799:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:2.0:1788841320.713820:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:2.0:1788841320.713856:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:2.0:1788841320.713870:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:2.0:1788841320.714453:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:2.0:1788841320.714601:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:2.0:1788841320.714621:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:2.0:1788841320.714634:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:2.0:1788841320.714647:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:2.0:1788841320.714660:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:2.0:1788841320.714672:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:2.0:1788841320.714684:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:2.0:1788841320.714696:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:2.0:1788841320.714708:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:2.0:1788841320.714720:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:2.0:1788841320.714732:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:2.0:1788841320.714743:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:2.0:1788841320.714769:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:2.0:1788841320.714782:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:2.0:1788841320.714794:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:2.0:1788841320.714806:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:2.0:1788841320.714817:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:2.0:1788841320.715005:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:2.0:1788841320.715026:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:2.0:1788841320.715044:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:2.0:1788841320.715048:0:23505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:2.0:1788841320.716311:0:23505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47b45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:23505:1875735413507968:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788841320.716387:0:23505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841320.717236:0:23505:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b43383780 going to sleep for 11 seconds 00000100:00100000:0.0:1788841320.722968:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413507968 00000100:00100000:0.0:1788841320.722985:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413507968 00000100:00100000:0.0:1788841320.723040:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788841320.723050:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7060fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+18:23505:x1875735413507968:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788841320.723233:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7060fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+18:23505:x1875735413507968:12345-0@lo:501:mount.lustre.0 Request processed in 184us (6845us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841320.723247:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788841320.723760:0:23505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47b45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:23505:1875735413507968:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788841320.723806:0:23505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47b45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:23505:1875735413508096:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788841320.723869:0:23505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841320.723893:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413508096 00000100:00100000:2.0:1788841320.723896:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413508096 00000100:00100000:2.0:1788841320.723922:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788841320.723928:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7060dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+18:23505:x1875735413508096:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788841320.723996:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7060dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+18:23505:x1875735413508096:12345-0@lo:503:mount.lustre.0 Request processed in 67us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841320.724002:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788841320.724042:0:23505:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b43383780 going to sleep for 11 seconds 00000100:00100000:2.0:1788841320.724054:0:23505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47b45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:23505:1875735413508096:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788841320.724439:0:23505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788841320.724496:0:23505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47b45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:23505:1875735413508224:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788841320.724527:0:23505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841320.724549:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413508224 00000100:00100000:2.0:1788841320.724553:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413508224 00000100:00100000:2.0:1788841320.724572:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788841320.724577:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7060d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+18:23505:x1875735413508224:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788841320.724643:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7060d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+18:23505:x1875735413508224:12345-0@lo:502:mount.lustre.0 Request processed in 65us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841320.724650:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788841320.724677:0:23505:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b43383c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788841320.724687:0:23505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47b45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:23505:1875735413508224:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788841320.724821:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:2.0:1788841320.724863:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:2.0:1788841320.724875:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:2.0:1788841320.724886:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:2.0:1788841320.728047:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:2.0:1788841320.728127:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:2.0:1788841320.728145:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:2.0:1788841320.728159:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:2.0:1788841320.728173:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:2.0:1788841320.728186:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:2.0:1788841320.728199:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:2.0:1788841320.728214:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:2.0:1788841320.728228:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:2.0:1788841320.728240:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:2.0:1788841320.728253:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:2.0:1788841320.728267:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:2.0:1788841320.728282:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:2.0:1788841320.728296:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:2.0:1788841320.728325:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:2.0:1788841320.728342:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:2.0:1788841320.728355:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:2.0:1788841320.728369:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:2.0:1788841320.728383:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:2.0:1788841320.728399:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:2.0:1788841320.728425:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:2.0:1788841320.728438:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:2.0:1788841320.728450:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:2.0:1788841320.728462:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:2.0:1788841320.728483:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:2.0:1788841320.728496:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:2.0:1788841320.728507:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:2.0:1788841320.728517:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:2.0:1788841320.728537:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:2.0:1788841320.728549:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:2.0:1788841320.728569:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:2.0:1788841320.728581:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:2.0:1788841320.728592:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:2.0:1788841320.728603:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:2.0:1788841320.728614:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:2.0:1788841320.728624:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:2.0:1788841320.728635:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:2.0:1788841320.728647:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:2.0:1788841320.728661:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:2.0:1788841320.728674:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:2.0:1788841320.728687:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:2.0:1788841320.728699:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:2.0:1788841320.728712:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:2.0:1788841320.728722:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:2.0:1788841320.728776:0:23505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47b45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:23505:1875735413508352:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788841320.728879:0:23505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841320.728935:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413508352 00000100:00100000:2.0:1788841320.728942:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413508352 00000100:00100000:2.0:1788841320.728999:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788841320.729009:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47ee7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+18:23505:x1875735413508352:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788841320.729115:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47ee7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+18:23505:x1875735413508352:12345-0@lo:502:mount.lustre.0 Request processed in 107us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841320.729122:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788841320.729174:0:23505:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b43383c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788841320.729196:0:23505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47b45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:23505:1875735413508352:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788841320.729369:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:2.0:1788841320.729392:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:2.0:1788841320.729433:0:23505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47b45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:23505:1875735413508480:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788841320.729465:0:23505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841320.729488:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413508480 00000100:00100000:2.0:1788841320.729492:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413508480 00000100:00100000:2.0:1788841320.729514:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788841320.729520:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47ee6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+18:23505:x1875735413508480:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788841320.729575:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47ee6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+18:23505:x1875735413508480:12345-0@lo:502:mount.lustre.0 Request processed in 55us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841320.729582:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788841320.729610:0:23505:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b43383c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788841320.729622:0:23505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47b45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:23505:1875735413508480:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788841320.729654:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:2.0:1788841320.729661:0:23505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788841320.732314:0:23524:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1788841320.732332:0:23524:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffffa04b5c8499b8) 00000020:00000080:2.0:1788841320.732355:0:23524:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1788841320.732447:0:23524:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa04b521ab000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788841320.732452:0:23524:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa04b521ab000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788841320.732455:0:23524:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa04b521ab000 3 00010000:00080000:2.0:1788841320.732551:0:23524:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa04b7f6fe800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.107@tcp at head 00010000:00010000:2.0:1788841320.734986:0:23524:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1788841320.735192:0:23524:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1788841320.735237:0:23524:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788841320.735251:0:23524:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x5757cd208ac3822d 00000100:00080000:2.0:1788841320.735262:0:23524:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788841320.735268:0:23524:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffffa04b7f6fe800 using connection 192.168.204.107@tcp/0@lo 00000100:00100000:2.0:1788841320.735305:0:23524:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa04a47b45180 x1875735413508608/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788841320.735340:0:23524:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788841320.735370:0:11140:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788841320.735375:0:11140:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788841320.735377:0:11140:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788841320.735380:0:11140:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788841320.735572:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875735413508608:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788841320.735646:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841320.738591:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413508608 00000100:00100000:2.0:1788841320.738605:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413508608 00000100:00100000:2.0:1788841320.738649:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788841320.738657:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7c028000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1875735413508608:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788841320.738684:0:22774:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 754 last 0 00000020:00000080:2.0:1788841320.738734:0:22774:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x5757cd208ac38234 00000004:00100000:2.0:1788841320.738751:0:22774:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788841320.738783:0:22774:0:(import.c:65:import_set_state_nolock()) ffffa04b7d09b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788841320.738880:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7c028000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875735413508608:12345-0@lo:38:llog_process_th.0 Request processed in 222us (3233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841320.738887:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788841320.741359:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa04a47b45180 x1875735413508608/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788841330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841320.741374:0:3648:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788841320.741385:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1788841320.741393:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788841320.741397:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788841320.741401:0:3648:0:(import.c:65:import_set_state_nolock()) ffffa04b7f6fe800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788841320.741418:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875735413508608:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1788841320.745113:0:23524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:2.0:1788841320.745199:0:23505:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788841320.745227:0:23505:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.107@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788841320.745247:0:23505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b81b5d200/0x5757cd208ac38218 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac3821f expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841320.745258:0:23505:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.107@tcp lock: ffffa04b81b5d200/0x5757cd208ac38218 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac3821f expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788841320.745305:0:23505:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788841320.745307:0:23505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788841320.745308:0:23505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788841320.745309:0:23505:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788841320.745311:0:23505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788841320.745312:0:23505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788841320.745314:0:23505:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788841320.745316:0:23505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788841320.745317:0:23505:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788841320.745321:0:23505:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1788841320.745323:0:23505:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788841320.745325:0:23505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788841320.745326:0:23505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788841320.745327:0:23505:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788841320.745328:0:23505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788841320.745329:0:23505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788841320.745330:0:23505:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788841320.745331:0:23505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788841320.745332:0:23505:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788841320.745358:0:23505:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788841320.745376:0:23505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47b45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:23505:1875735413508736:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788841320.745455:0:23505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841320.745502:0:23505:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b6e021840 going to sleep for 11 seconds 00000100:00100000:2.0:1788841320.745530:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413508736 00000100:00100000:2.0:1788841320.745536:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413508736 00000100:00100000:2.0:1788841320.745583:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788841320.745590:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47ee5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+18:23505:x1875735413508736:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788841320.745613:0:22764:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788841320.745625:0:22764:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1788841320.746969:0:22752:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1788841320.746996:0:22764:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788841320.747006:0:22764:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1788841320.747052:0:22788:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788841320.747056:0:22788:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788841320.747075:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa04b81b5c200/0x5757cd208ac3823b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841320.747093:0:22788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa04b81b5c000/0x5757cd208ac3813f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5757cd208ac38138 expref: 18 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841320.747101:0:22788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa04b81b5d800/0x5757cd208ac38203 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5757cd208ac381fc expref: 18 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841320.747108:0:22788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa04b81b5c200/0x5757cd208ac3823b lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841320.747141:0:22788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa04b81b5d800/0x5757cd208ac38203 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5757cd208ac381fc expref: 18 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841320.747157:0:22788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa04b81b5d800/0x5757cd208ac38203 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5757cd208ac381fc expref: 18 pid: 22766 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841320.747169:0:22788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47b44380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22788:1875735413508864:0@lo:104: 00000100:00100000:2.0:1788841320.747225:0:22788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788841320.747260:0:22788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa04b81b5c000/0x5757cd208ac3813f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5757cd208ac38138 expref: 18 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841320.747282:0:22788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa04b81b5c000/0x5757cd208ac3813f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5757cd208ac38138 expref: 18 pid: 22764 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841320.747291:0:22788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47b45880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22788:1875735413508992:0@lo:104: 00000100:00100000:2.0:1788841320.747314:0:22788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841320.747329:0:22788:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b7f984e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788841320.747361:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413508864 00000100:00100000:2.0:1788841320.747368:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413508864 00000100:00100000:2.0:1788841320.747394:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413508992 00000100:00100000:2.0:1788841320.747396:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413508992 00000100:00100000:2.0:1788841320.747417:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788841320.747425:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47b46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a456da20-a415-4617-896c-ee7aa5e4c089+4:22788:x1875735413508864:12345-0@lo:104: 00010000:00010000:2.0:1788841320.747436:0:22756:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.107@tcp lock: ffffa04b48dc6200/0x5757cd208ac381fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5757cd208ac38203 expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841320.747484:0:22756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788841320.747490:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47b46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a456da20-a415-4617-896c-ee7aa5e4c089+4:22788:x1875735413508864:12345-0@lo:104: Request processed in 66us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841320.747497:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788841320.747511:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788841320.747516:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47b47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a456da20-a415-4617-896c-ee7aa5e4c089+3:22788:x1875735413508992:12345-0@lo:104: 00010000:00010000:2.0:1788841320.747522:0:22756:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.107@tcp lock: ffffa04a474ae000/0x5757cd208ac38138 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5757cd208ac3813f expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841320.747547:0:22756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788841320.747552:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47b47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a456da20-a415-4617-896c-ee7aa5e4c089+3:22788:x1875735413508992:12345-0@lo:104: Request processed in 36us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841320.747567:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788841320.747583:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788841320.747594:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.107@tcp lock: ffffa04b48dc6200/0x5757cd208ac381fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5757cd208ac38203 expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841320.747601:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b48dc6200 already unused, calling callback (ffffffffc11a4c20) 10000000:00010000:2.0:1788841320.747605:0:22761:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.107@tcp lock: ffffa04b48dc6200/0x5757cd208ac381fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5757cd208ac38203 expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841320.747615:0:22761:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.107@tcp lock: ffffa04b48dc6200/0x5757cd208ac381fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5757cd208ac38203 expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788841320.747622:0:22761:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.107@tcp lock: ffffa04b48dc6200/0x5757cd208ac381fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5757cd208ac38203 expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788841320.747629:0:22761:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788841320.747652:0:22761:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.107@tcp lock: ffffa04b48dc6200/0x5757cd208ac381fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5757cd208ac38203 expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841320.747658:0:22761:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788841320.747676:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.107@tcp lock: ffffa04b48dc6200/0x5757cd208ac381fc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5757cd208ac38203 expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841320.747684:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.107@tcp lock: ffffa04b48dc6200/0x5757cd208ac381fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5757cd208ac38203 expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841320.747697:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788841320.747700:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.107@tcp lock: ffffa04a474ae000/0x5757cd208ac38138 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5757cd208ac3813f expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841320.747716:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a474ae000 already unused, calling callback (ffffffffc11a4c20) 10000000:00010000:2.0:1788841320.747718:0:22761:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.107@tcp lock: ffffa04a474ae000/0x5757cd208ac38138 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5757cd208ac3813f expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841320.747724:0:22761:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.107@tcp lock: ffffa04a474ae000/0x5757cd208ac38138 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5757cd208ac3813f expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788841320.747730:0:22761:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.107@tcp lock: ffffa04a474ae000/0x5757cd208ac38138 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5757cd208ac3813f expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788841320.747734:0:22761:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788841320.747747:0:22761:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.107@tcp lock: ffffa04a474ae000/0x5757cd208ac38138 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5757cd208ac3813f expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841320.747752:0:22761:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788841320.747766:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.107@tcp lock: ffffa04a474ae000/0x5757cd208ac38138 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5757cd208ac3813f expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841320.747772:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.107@tcp lock: ffffa04a474ae000/0x5757cd208ac38138 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5757cd208ac3813f expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841320.747786:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841320.747788:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841320.747789:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841320.747796:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788841320.747812:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47b46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a456da20-a415-4617-896c-ee7aa5e4c089:3652:1875735413509120:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788841320.747860:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841320.747889:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a456da20-a415-4617-896c-ee7aa5e4c089:3649:1875735413509248:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788841320.747916:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841320.747944:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413509120 00000100:00100000:2.0:1788841320.747947:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413509120 00010000:00010000:2.0:1788841320.747962:0:22757:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa04b81b5d800/0x5757cd208ac38203 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5757cd208ac381fc expref: 19 pid: 22766 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841320.747978:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413509248 00000100:00100000:2.0:1788841320.747981:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413509248 00010000:00010000:2.0:1788841320.747988:0:22757:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa04b81b5c000/0x5757cd208ac3813f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5757cd208ac38138 expref: 20 pid: 22764 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841320.747998:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788841320.748003:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47b46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a456da20-a415-4617-896c-ee7aa5e4c089+20:3652:x1875735413509120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788841320.748011:0:22757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788841320.748015:0:22757:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa04b81b5d800/0x5757cd208ac38203 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5757cd208ac381fc expref: 20 pid: 22766 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841320.748024:0:22757:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa04b81b5d800/0x5757cd208ac38203 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5757cd208ac381fc expref: 20 pid: 22766 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841320.748039:0:22757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788841320.748059:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47b46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a456da20-a415-4617-896c-ee7aa5e4c089+20:3652:x1875735413509120:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841320.748065:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788841320.748075:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788841320.748080:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a456da20-a415-4617-896c-ee7aa5e4c089+19:3649:x1875735413509248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788841320.748087:0:22757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788841320.748091:0:22757:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa04b81b5c000/0x5757cd208ac3813f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5757cd208ac38138 expref: 19 pid: 22764 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841320.748110:0:22757:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa04b81b5c000/0x5757cd208ac3813f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5757cd208ac38138 expref: 19 pid: 22764 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841320.748122:0:22757:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa04b81b5c200/0x5757cd208ac3823b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841320.748130:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa04b81b5c200/0x5757cd208ac3823b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788841320.748142:0:22757:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001547370s 00010000:00010000:2.0:1788841320.748146:0:22757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa04b81b5c200/0x5757cd208ac3823b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841320.748153:0:22757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa04b81b5c200/0x5757cd208ac3823b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841320.748159:0:22757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa04b81b5c200/0x5757cd208ac3823b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841320.748166:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa04b81b5c200/0x5757cd208ac3823b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841320.748172:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b81b5c200 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:2.0:1788841320.748176:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa04b81b5c200/0x5757cd208ac3823b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841320.748183:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa04b81b5c200/0x5757cd208ac3823b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841320.748190:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa04b81b5c200/0x5757cd208ac3823b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841320.748205:0:22757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788841320.748232:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a456da20-a415-4617-896c-ee7aa5e4c089+19:3649:x1875735413509248:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841320.748238:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788841320.748277:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a456da20-a415-4617-896c-ee7aa5e4c089:3649:1875735413509248:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788841320.748301:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47b46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a456da20-a415-4617-896c-ee7aa5e4c089:3652:1875735413509120:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788841320.748324:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa04b81b5d800/0x5757cd208ac38203 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5757cd208ac381fc expref: 18 pid: 22766 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841320.748333:0:22788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47b44380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22788:1875735413508864:0@lo:104: 00010000:00010000:2.0:1788841320.748342:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa04b81b5c000/0x5757cd208ac3813f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5757cd208ac38138 expref: 17 pid: 22764 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841320.748350:0:22788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47b45880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22788:1875735413508992:0@lo:104: 00010000:00010000:2.0:1788841320.748361:0:22788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa04b81b5c200/0x5757cd208ac3823b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841320.748369:0:22788:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa04b81b5c200/0x5757cd208ac3823b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841320.748376:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa04b81b5c200/0x5757cd208ac3823b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841320.748382:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa04b81b5c200/0x5757cd208ac3823b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841320.750443:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47ee5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+16:23505:x1875735413508736:12345-0@lo:253:mount.lustre.0 Request processed in 4845us (4980us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841320.750462:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788841320.750723:0:23505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47b45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:23505:1875735413508736:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788841320.750740:0:23505:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788841320.750744:0:23505:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788841320.750747:0:23505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788841320.750748:0:23505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788841320.750750:0:23505:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788841320.750751:0:23505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788841320.750753:0:23505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788841320.750754:0:23505:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788841320.750756:0:23505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788841320.750757:0:23505:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788841320.750773:0:23505:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000040:01000000:2.0:1788841320.757638:0:23505:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1788841320.757744:0:23530:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1788841320.757748:0:23530:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:1.0:1788841320.757874:0:23531:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788841320.758204:0:23505:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:01000000:2.0:1788841320.758448:0:23505:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1788841320.758503:0:23505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788841320.759013:0:23505:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788841320.759019:0:23505:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1788841320.759051:0:23505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788841320.759982:0:23505:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788841320.760528:0:23505:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788841320.760556:0:23505:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1788841320.760712:0:23531:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788841320.763094:0:23531:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788841320.763189:0:23531:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:00080000:2.0:1788841320.763775:0:23505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788841320.764309:0:23505:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000100:00100000:0.0:1788841320.765211:0:23532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c02b100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23532:1875735413509376:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788841320.765280:0:23532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841320.765318:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413509376 00000100:00100000:0.0:1788841320.765326:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413509376 00000100:00100000:0.0:1788841320.765374:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788841320.765384:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7c029c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23532:x1875735413509376:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788841320.765468:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7c029c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23532:x1875735413509376:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 85us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841320.765486:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788841320.765509:0:23532:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b7fe02600 going to sleep for 11 seconds 00000100:00100000:0.0:1788841320.765531:0:23532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c02b100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23532:1875735413509376:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1788841320.765557:0:23532:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788841320.765582:0:23532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c02b100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23532:1875735413509504:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788841320.765608:0:23532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841320.765626:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413509504 00000100:00100000:0.0:1788841320.765629:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413509504 00000100:00100000:0.0:1788841320.765647:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788841320.765652:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7c02b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23532:x1875735413509504:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788841320.765735:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7c02b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23532:x1875735413509504:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 82us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841320.765741:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788841320.765765:0:23532:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b7fe02600 going to sleep for 11 seconds 00000100:00100000:0.0:1788841320.765778:0:23532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c02b100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23532:1875735413509504:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788841320.765828:0:23532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c02b100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23532:1875735413509632:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788841320.765873:0:23532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841320.765910:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413509632 00000100:00100000:0.0:1788841320.765913:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413509632 00000100:00100000:0.0:1788841320.765939:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788841320.765945:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7c029180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23532:x1875735413509632:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788841320.765976:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7c029180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23532:x1875735413509632:12345-0@lo:900:lod0001_rec0000.0 Request processed in 31us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841320.765981:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788841320.765995:0:23532:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b7fe02d80 going to sleep for 11 seconds 00010000:00080000:0.0:1788841320.766007:0:23532:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa04b7c02b100 x1875735413509632/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788841336 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841320.766018:0:23532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c02b100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23532:1875735413509632:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788841320.766051:0:23532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c02b100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23532:1875735413509760:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788841320.766087:0:23532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841320.766107:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413509760 00000100:00100000:0.0:1788841320.766110:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413509760 00000100:00100000:0.0:1788841320.766126:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788841320.766132:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7c02bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23532:x1875735413509760:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788841320.766173:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7c02bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23532:x1875735413509760:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 40us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841320.766179:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788841320.766193:0:23532:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b7fe02600 going to sleep for 11 seconds 00000100:00100000:0.0:1788841320.766211:0:23532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c02b100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23532:1875735413509760:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1788841320.766245:0:23532:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00000004:2.0:1788841320.769555:0:23505:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000040:00080000:0.0:1788841320.771050:0:23532:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788841320.771121:0:23532:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788841320.771126:0:23532:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:3.0:1788841320.779115:0:23505:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788841320.779158:0:23505:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffbd76c1c43988 00100000:10000000:3.0:1788841320.779166:0:23505:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1788841320.779920:0:23505:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788841320.779956:0:23505:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.107@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788841320.779988:0:23505:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788841320.780014:0:23505:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1788841320.780817:0:23505:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788841320.781057:0:23505:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788841320.789914:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788841321.167953:0:22814:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b429d8cc0 going to sleep for 0 seconds 00000040:00080000:2.0:1788841321.747730:0:23525:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788841321.806650:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788841322.189596:0:22814:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b429d8cc0 going to sleep for 0 seconds 10000000:01000000:0.0:1788841322.255678:0:22769:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788841322.255685:0:22769:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa04b521ab000 from 12 10000000:01000000:0.0:1788841322.255690:0:22769:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788841322.255736:0:22769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04a474ae000/0x5757cd208ac38242 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841322.255749:0:22769:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.107@tcp lock: ffffa04a474ae000/0x5757cd208ac38242 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841322.255760:0:22769:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.107@tcp lock: ffffa04a474ae000/0x5757cd208ac38242 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841322.255787:0:22769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c02b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413509888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788841322.255883:0:22769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841322.255927:0:22769:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b7fe02d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788841322.256015:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413509888 00000100:00100000:1.0:1788841322.256022:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413509888 00000100:00100000:1.0:1788841322.256091:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788841322.256103:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47ee4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+16:22769:x1875735413509888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788841322.256116:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788841322.256130:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa04b48dc6400/0x5757cd208ac38249 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5757cd208ac38242 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841322.256157:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa04b48dc6400/0x5757cd208ac38249 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5757cd208ac38242 expref: 17 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841322.256168:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa04b48dc6400/0x5757cd208ac38249 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5757cd208ac38242 expref: 17 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841322.256177:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04b48dc6400, rc 0) 00000100:00100000:1.0:1788841322.256228:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47ee4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+17:22769:x1875735413509888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841322.256247:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788841322.256403:0:22769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c02b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413509888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788841322.256419:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.107@tcp lock: ffffa04a474ae000/0x5757cd208ac38242 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac38249 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841322.256428:0:22769:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.107@tcp lock: ffffa04a474ae000/0x5757cd208ac38242 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5757cd208ac38249 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841322.256480:0:22769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c02b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413510016:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788841322.256516:0:22769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841322.256545:0:22769:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b7fe02d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788841322.256640:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413510016 00000100:00100000:3.0:1788841322.256646:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413510016 00000100:00100000:3.0:1788841322.256680:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788841322.256687:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47ee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+17:22769:x1875735413510016:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788841322.256702:0:22764:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788841322.256717:0:22764:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788841322.256720:0:22764:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:3.0:1788841322.256788:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47ee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+17:22769:x1875735413510016:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 100us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841322.256795:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788841322.257047:0:22769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c02b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413510016:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788841322.257091:0:22769:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.107@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788841322.257098:0:22769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04a474ae000/0x5757cd208ac38242 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac38249 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841322.257106:0:22769:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.107@tcp lock: ffffa04a474ae000/0x5757cd208ac38242 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac38249 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788841322.257115:0:22769:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788841322.257117:0:22769:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa04a45f80000 from 12 10000000:01000000:0.0:1788841322.257119:0:22769:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788841322.257136:0:22769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04a474aea00/0x5757cd208ac38250 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841322.257142:0:22769:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.107@tcp lock: ffffa04a474aea00/0x5757cd208ac38250 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841322.257150:0:22769:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.107@tcp lock: ffffa04a474aea00/0x5757cd208ac38250 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841322.257161:0:22769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c02b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413510144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788841322.257184:0:22769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841322.257201:0:22769:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b7fe02d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788841322.257299:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413510144 00000100:00100000:1.0:1788841322.257304:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413510144 00000100:00100000:1.0:1788841322.257336:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788841322.257343:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47ee6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+17:22769:x1875735413510144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788841322.257352:0:22767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788841322.257362:0:22767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa04b48dc7c00/0x5757cd208ac38257 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5757cd208ac38250 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841322.257390:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa04b48dc7c00/0x5757cd208ac38257 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5757cd208ac38250 expref: 18 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841322.257399:0:22767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa04b48dc7c00/0x5757cd208ac38257 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5757cd208ac38250 expref: 18 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841322.257405:0:22767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04b48dc7c00, rc 0) 00000100:00100000:1.0:1788841322.257441:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47ee6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+18:22769:x1875735413510144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841322.257448:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788841322.258990:0:22769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c02b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413510144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788841322.259015:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.107@tcp lock: ffffa04a474aea00/0x5757cd208ac38250 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac38257 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841322.259043:0:22769:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.107@tcp lock: ffffa04a474aea00/0x5757cd208ac38250 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5757cd208ac38257 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841322.259103:0:22769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c02b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413510272:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788841322.259153:0:22769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841322.259195:0:22769:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b7fe02d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788841322.259267:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413510272 00000100:00100000:1.0:1788841322.259273:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413510272 00000100:00100000:1.0:1788841322.259317:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788841322.259326:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47ee4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+18:22769:x1875735413510272:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788841322.259343:0:22766:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788841322.259358:0:22766:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788841322.259361:0:22766:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:1.0:1788841322.259461:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47ee4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+18:22769:x1875735413510272:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 135us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841322.259475:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788841322.259667:0:22769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c02b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413510272:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788841322.259709:0:22769:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.107@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788841322.259716:0:22769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04a474aea00/0x5757cd208ac38250 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac38257 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841322.259725:0:22769:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.107@tcp lock: ffffa04a474aea00/0x5757cd208ac38250 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac38257 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788841322.765521:0:23525:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788841322.829028:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788841323.213065:0:22814:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b429d8cc0 going to sleep for 0 seconds 00010000:00010000:2.0:1788841323.854438:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788841324.236992:0:22814:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b429d8cc0 going to sleep for 0 seconds 00010000:00010000:3.0:1788841324.877976:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788841325.261233:0:22814:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b429d8cc0 going to sleep for 0 seconds 00010000:00010000:2.0:1788841325.902089:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788841325.922369:0:23775:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg407-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788841326.093042:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875735413510400:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1788841326.093213:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788841326.093219:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788841326.093224:0:37:0:(import.c:65:import_set_state_nolock()) ffffa04b7f429000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788841326.093233:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffffa04b7f429000 using connection 192.168.204.107@tcp/0@lo 00000100:00100000:3.0:1788841326.093261:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa04b6e05c700 x1875735413510656/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788841326.093287:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788841326.093291:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788841326.093294:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788841326.093297:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788841326.093325:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788841326.093328:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788841326.093331:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788841326.093335:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788841326.093464:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841326.093532:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875735413511040:0@lo:400:kworker.0 00000100:00100000:2.0:1788841326.093561:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841326.093579:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788841326.093585:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875735413510912:0@lo:400:kworker.0 00000100:00100000:2.0:1788841326.093603:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841326.093718:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413510400 00000100:00100000:3.0:1788841326.093727:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413510400 00000100:00100000:3.0:1788841326.093765:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413510912 00000100:00100000:3.0:1788841326.093768:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413510912 00000100:00100000:3.0:1788841326.093782:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788841326.093790:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47b45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3650:x1875735413510400:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788841326.093830:0:22777:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788841326.093899:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47b45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3650:x1875735413510400:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841326.093906:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788841326.093922:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788841326.093928:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47b44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875735413510912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841326.093956:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47b44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875735413510912:12345-0@lo:400:kworker.0 Request processed in 28us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841326.093962:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788841326.094267:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875735413510912:0@lo:400:kworker.0 00000100:00100000:2.0:1788841326.094285:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875735413510400:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788841326.094326:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a456da20-a415-4617-896c-ee7aa5e4c089:3651:1875735413510528:0@lo:400:kworker.0 00000100:00100000:2.0:1788841326.094358:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841326.094390:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788841326.094396:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875735413510784:0@lo:400:kworker.0 00000100:00100000:2.0:1788841326.094419:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841326.094453:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875735413510656:0@lo:38:kworker.0 00000100:00100000:2.0:1788841326.094481:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841326.094513:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413511040 00000100:00100000:2.0:1788841326.094517:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413511040 00000100:00100000:2.0:1788841326.094543:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413510784 00000100:00100000:2.0:1788841326.094545:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413510784 00000100:00100000:2.0:1788841326.094558:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788841326.094564:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47b45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875735413511040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841326.094595:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47b45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875735413511040:12345-0@lo:400:kworker.0 Request processed in 31us (1034us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841326.094608:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788841326.094719:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413510528 00000100:00100000:0.0:1788841326.094722:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413510528 00000100:00100000:0.0:1788841326.094759:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788841326.094765:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47ee6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+18:3651:x1875735413510528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841326.094800:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47ee6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+18:3651:x1875735413510528:12345-0@lo:400:kworker.0 Request processed in 35us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841326.094805:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788841326.094949:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788841326.094955:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47b46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875735413510784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841326.094981:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47b46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875735413510784:12345-0@lo:400:kworker.0 Request processed in 27us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841326.094986:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788841326.095000:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413510656 00000100:00100000:2.0:1788841326.095004:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413510656 00000100:00100000:2.0:1788841326.095014:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788841326.095017:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47b44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1875735413510656:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788841326.095037:0:22778:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 760 last 0 00000020:00000080:2.0:1788841326.095069:0:22778:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5757cd208ac3825e 00000004:00100000:2.0:1788841326.095083:0:22778:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788841326.095785:0:22778:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00010000:00080000:2.0:1788841326.096002:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa04b6e05ce00 x1875735413510784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841326.096017:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875735413510784:0@lo:400:kworker.0 00000100:00100000:2.0:1788841326.096029:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a456da20-a415-4617-896c-ee7aa5e4c089:3651:1875735413510528:0@lo:400:kworker.0 00010000:00080000:2.0:1788841326.096063:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa04b6e05f800 x1875735413511040/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841326.096072:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875735413511040:0@lo:400:kworker.0 00000100:00080000:3.0:1788841326.117334:0:22778:0:(import.c:65:import_set_state_nolock()) ffffa04b7d09f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788841326.117489:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47b44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1875735413510656:12345-0@lo:38:kworker.0 Request processed in 22468us (23005us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841326.117500:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1788841326.117739:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788841326.117750:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788841326.117764:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788841326.117767:0:3648:0:(import.c:65:import_set_state_nolock()) ffffa04b7f429000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1788841326.117859:0:3648:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000003e7bcb6a): req@ffffa04b6e05e300 x1875735413503616/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841326.117880:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875735413510656:0@lo:38:kworker.0 00000100:00100000:1.0:1788841326.118093:0:22814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841326.118222:0:22814:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b429d8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788841326.118516:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413503616 00000100:00100000:2.0:1788841326.118523:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413503616 00000100:00100000:2.0:1788841326.118572:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788841326.118582:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6d9e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22814:x1875735413503616:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788841326.118671:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6d9e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22814:x1875735413503616:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 90us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841326.118678:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788841326.118710:0:22814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05e300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22814:1875735413503616:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1788841326.118742:0:22814:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788841326.118787:0:22814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47b47800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22814:1875735413511168:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788841326.118821:0:22814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841326.118873:0:22814:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b67752840 going to sleep for 11 seconds 00000100:00100000:2.0:1788841326.118884:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413511168 00000100:00100000:2.0:1788841326.118887:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413511168 00000100:00100000:2.0:1788841326.118905:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788841326.118911:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b491d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22814:x1875735413511168:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788841326.119002:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b491d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22814:x1875735413511168:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 90us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841326.119008:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788841326.119033:0:22814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47b47800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22814:1875735413511168:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788841326.119326:0:22814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b491d1180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22814:1875735413511296:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788841326.119353:0:22814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841326.119385:0:22814:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b67752840 going to sleep for 11 seconds 00000100:00100000:0.0:1788841326.119480:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413511296 00000100:00100000:0.0:1788841326.119485:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413511296 00000100:00100000:0.0:1788841326.119520:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788841326.119528:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b491d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22814:x1875735413511296:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788841326.119588:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b491d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22814:x1875735413511296:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 62us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841326.119594:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788841326.119653:0:22814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b491d1180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22814:1875735413511296:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1788841326.119690:0:22814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788841326.122256:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875735413511424:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788841326.122330:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841326.122454:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413511424 00000100:00100000:3.0:1788841326.122463:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413511424 00000100:00100000:3.0:1788841326.122508:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788841326.122517:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6e05fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1875735413511424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788841326.122551:0:22777:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788841326.122594:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6e05fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1875735413511424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841326.122601:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788841326.122643:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875735413511424:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1788841326.124507:0:22814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788841326.124595:0:22814:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 20, retries 0 00000004:00080000:2.0:1788841326.124601:0:22814:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1788841326.924992:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788841326.976105:0:23827:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788841326.976353:0:23827:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788841327.950200:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788841327.984405:0:23877:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788841327.984624:0:23877:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:1.0:1788841328.270965:0:22808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788841328.973219:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788841329.215122:0:23925:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff453788d0 20000000:00000080:3.0:1788841329.215142:0:23925:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa04b67693000 uarg=0000000000000000 20000000:01000000:3.0:1788841329.215186:0:23925:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788841329.215200:0:23925:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788841329.215205:0:23925:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788841329.218412:0:23926:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1788841329.218570:0:23925:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788841329.231075:0:23925:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788841329.231109:0:23925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa04b81b5c400/0x5757cd208ac38265 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841329.231128:0:23925:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa04b7a722c00/0x5757cd208ac3810e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5757cd208ac38107 expref: 17 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841329.231136:0:23925:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa04a474aee00/0x5757cd208ac38211 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5757cd208ac3820a expref: 17 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841329.231144:0:23925:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa04b81b5c400/0x5757cd208ac38265 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841329.232077:0:23925:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa04a474aee00/0x5757cd208ac38211 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5757cd208ac3820a expref: 17 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841329.232109:0:23925:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa04a474aee00/0x5757cd208ac38211 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5757cd208ac3820a expref: 17 pid: 22764 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841329.232143:0:23925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b491d1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23925:1875735413511552:0@lo:104: 00000100:00100000:2.0:1788841329.236387:0:23925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788841329.236495:0:23925:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa04b7a722c00/0x5757cd208ac3810e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5757cd208ac38107 expref: 17 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841329.236513:0:23925:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa04b7a722c00/0x5757cd208ac3810e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5757cd208ac38107 expref: 17 pid: 22767 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841329.236530:0:23925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b491d0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23925:1875735413511680:0@lo:104: 00000100:00100000:2.0:1788841329.236576:0:23925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841329.236594:0:23925:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b6e0203c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788841329.236679:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413511552 00000100:00100000:3.0:1788841329.236688:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413511552 00000100:00100000:3.0:1788841329.236734:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413511680 00000100:00100000:3.0:1788841329.236738:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413511680 00000100:00100000:3.0:1788841329.236753:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788841329.236761:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b491d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a456da20-a415-4617-896c-ee7aa5e4c089+4:23925:x1875735413511552:12345-0@lo:104: 00010000:00010000:3.0:1788841329.236775:0:22755:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.107@tcp lock: ffffa04b48dc7400/0x5757cd208ac3820a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5757cd208ac38211 expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841329.236869:0:22755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788841329.236876:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b491d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a456da20-a415-4617-896c-ee7aa5e4c089+4:23925:x1875735413511552:12345-0@lo:104: Request processed in 116us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841329.236884:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788841329.236902:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788841329.236908:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b491d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a456da20-a415-4617-896c-ee7aa5e4c089+3:23925:x1875735413511680:12345-0@lo:104: 00010000:00010000:3.0:1788841329.236916:0:22755:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.107@tcp lock: ffffa04b81b5de00/0x5757cd208ac38107 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5757cd208ac3810e expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841329.236949:0:22755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788841329.236953:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b491d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a456da20-a415-4617-896c-ee7aa5e4c089+3:23925:x1875735413511680:12345-0@lo:104: Request processed in 47us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841329.236958:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1788841329.236975:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788841329.236981:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.107@tcp lock: ffffa04b48dc7400/0x5757cd208ac3820a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5757cd208ac38211 expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841329.236988:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b48dc7400 already unused, calling callback (ffffffffc11a4c20) 10000000:00010000:3.0:1788841329.236992:0:22760:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.107@tcp lock: ffffa04b48dc7400/0x5757cd208ac3820a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5757cd208ac38211 expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841329.237001:0:22760:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.107@tcp lock: ffffa04b48dc7400/0x5757cd208ac3820a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5757cd208ac38211 expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788841329.237009:0:22760:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.107@tcp lock: ffffa04b48dc7400/0x5757cd208ac3820a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5757cd208ac38211 expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788841329.237016:0:22760:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788841329.237054:0:22760:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.107@tcp lock: ffffa04b48dc7400/0x5757cd208ac3820a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5757cd208ac38211 expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841329.237062:0:22760:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788841329.237095:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.107@tcp lock: ffffa04b48dc7400/0x5757cd208ac3820a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5757cd208ac38211 expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841329.237103:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.107@tcp lock: ffffa04b48dc7400/0x5757cd208ac3820a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5757cd208ac38211 expref: -99 pid: 23505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841329.237114:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788841329.237118:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.107@tcp lock: ffffa04b81b5de00/0x5757cd208ac38107 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5757cd208ac3810e expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841329.237124:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b81b5de00 already unused, calling callback (ffffffffc11a4c20) 10000000:00010000:3.0:1788841329.237127:0:22760:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.107@tcp lock: ffffa04b81b5de00/0x5757cd208ac38107 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5757cd208ac3810e expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841329.237134:0:22760:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.107@tcp lock: ffffa04b81b5de00/0x5757cd208ac38107 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5757cd208ac3810e expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788841329.237140:0:22760:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.107@tcp lock: ffffa04b81b5de00/0x5757cd208ac38107 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5757cd208ac3810e expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788841329.237146:0:22760:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788841329.237160:0:22760:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.107@tcp lock: ffffa04b81b5de00/0x5757cd208ac38107 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5757cd208ac3810e expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841329.237165:0:22760:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788841329.237193:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.107@tcp lock: ffffa04b81b5de00/0x5757cd208ac38107 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5757cd208ac3810e expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841329.237212:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.107@tcp lock: ffffa04b81b5de00/0x5757cd208ac38107 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5757cd208ac3810e expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841329.237225:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841329.237227:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841329.237229:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841329.237237:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841329.237271:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a456da20-a415-4617-896c-ee7aa5e4c089:3652:1875735413511808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788841329.237306:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841329.237351:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a456da20-a415-4617-896c-ee7aa5e4c089:3649:1875735413511936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788841329.237374:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841329.237417:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413511808 00000100:00100000:3.0:1788841329.237422:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413511808 00010000:00010000:3.0:1788841329.237438:0:22758:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa04a474aee00/0x5757cd208ac38211 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5757cd208ac3820a expref: 18 pid: 22764 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841329.237458:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413511936 00000100:00100000:3.0:1788841329.237461:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413511936 00010000:00010000:3.0:1788841329.237472:0:22758:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa04b7a722c00/0x5757cd208ac3810e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5757cd208ac38107 expref: 19 pid: 22767 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841329.237484:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788841329.237490:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6e05ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a456da20-a415-4617-896c-ee7aa5e4c089+19:3652:x1875735413511808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788841329.237500:0:22758:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788841329.237506:0:22758:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa04a474aee00/0x5757cd208ac38211 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5757cd208ac3820a expref: 19 pid: 22764 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841329.237526:0:22758:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa04a474aee00/0x5757cd208ac38211 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5757cd208ac3820a expref: 19 pid: 22764 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841329.237542:0:22758:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788841329.237572:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6e05ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a456da20-a415-4617-896c-ee7aa5e4c089+19:3652:x1875735413511808:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841329.237579:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788841329.237593:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788841329.237599:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6e05c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a456da20-a415-4617-896c-ee7aa5e4c089+18:3649:x1875735413511936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788841329.237607:0:22758:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788841329.237611:0:22758:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa04b7a722c00/0x5757cd208ac3810e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5757cd208ac38107 expref: 18 pid: 22767 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841329.237620:0:22758:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa04b7a722c00/0x5757cd208ac3810e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5757cd208ac38107 expref: 18 pid: 22767 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841329.237632:0:22758:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa04b81b5c400/0x5757cd208ac38265 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841329.237640:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa04b81b5c400/0x5757cd208ac38265 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841329.237653:0:22758:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa04b81b5c400/0x5757cd208ac38265 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841329.237660:0:22758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa04b81b5c400/0x5757cd208ac38265 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841329.237666:0:22758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa04b81b5c400/0x5757cd208ac38265 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841329.237679:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa04b81b5c400/0x5757cd208ac38265 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841329.237684:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b81b5c400 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:3.0:1788841329.237688:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa04b81b5c400/0x5757cd208ac38265 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841329.237696:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa04b81b5c400/0x5757cd208ac38265 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841329.237704:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa04b81b5c400/0x5757cd208ac38265 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841329.237713:0:22758:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788841329.237743:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6e05c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a456da20-a415-4617-896c-ee7aa5e4c089+18:3649:x1875735413511936:12345-0@lo:103:ldlm_bl.0 Request processed in 144us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841329.237749:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788841329.237786:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a456da20-a415-4617-896c-ee7aa5e4c089:3649:1875735413511936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788841329.237811:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a456da20-a415-4617-896c-ee7aa5e4c089:3652:1875735413511808:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788841329.238414:0:23925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa04a474aee00/0x5757cd208ac38211 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5757cd208ac3820a expref: 17 pid: 22764 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841329.238427:0:23925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b491d1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23925:1875735413511552:0@lo:104: 00010000:00010000:2.0:1788841329.238437:0:23925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa04b7a722c00/0x5757cd208ac3810e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5757cd208ac38107 expref: 16 pid: 22767 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841329.238444:0:23925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b491d0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23925:1875735413511680:0@lo:104: 00010000:00010000:2.0:1788841329.238462:0:23925:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa04b81b5c400/0x5757cd208ac38265 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841329.238471:0:23925:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa04b81b5c400/0x5757cd208ac38265 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841329.238477:0:23925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa04b81b5c400/0x5757cd208ac38265 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841329.238498:0:23925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa04b81b5c400/0x5757cd208ac38265 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841330.000988:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788841330.189739:0:3648:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788841320/real 1788841320] req@ffffa04b6e05f480 x1875735413506816/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788841330 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841330.189782:0:3648:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa04b6e05f480 x1875735413506816/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788841330 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841330.189795:0:3648:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788841320/real 1788841320] req@ffffa04b6d9e1c00 x1875735413506688/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788841330 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841330.189808:0:3648:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa04b6d9e1c00 x1875735413506688/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788841330 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788841330.189868:0:3648:0:(import.c:65:import_set_state_nolock()) ffffa04b7cea3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788841330.189891:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788841330.189896:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875735413506816:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788841330.189903:0:3648:0:(import.c:65:import_set_state_nolock()) ffffa04b7cf0c800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788841330.189909:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788841330.189913:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6d9e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875735413506688:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1788841330.190053:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6d9e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a456da20-a415-4617-896c-ee7aa5e4c089:3650:1875735413512064:0@lo:400:kworker.0 00000100:00100000:2.0:1788841330.190146:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841330.190268:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413512064 00000100:00100000:0.0:1788841330.190278:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413512064 00000100:00100000:0.0:1788841330.190338:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788841330.190350:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47ee5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+16:3650:x1875735413512064:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788841330.193280:0:11140:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788841330.193290:0:11140:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788841330.193293:0:11140:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788841330.193297:0:11140:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788841330.193325:0:11140:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788841330.193329:0:11140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788841330.193333:0:11140:0:(import.c:65:import_set_state_nolock()) ffffa04b7cf0c800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788841330.193343:0:11140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 754 00000100:00080000:1.0:1788841330.193350:0:11140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788841330.193359:0:11140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffffa04b7cf0c800 using connection 192.168.204.107@tcp/0@lo 00000100:00100000:1.0:1788841330.193390:0:11140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa04b6d9e0000 x1875735413512576/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788841330.193409:0:11140:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788841330.193412:0:11140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788841330.193414:0:11140:0:(import.c:65:import_set_state_nolock()) ffffa04b7cea3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788841330.193430:0:11140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 754 00000100:00080000:1.0:1788841330.193453:0:11140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788841330.193458:0:11140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffffa04b7cea3800 using connection 192.168.204.107@tcp/0@lo 00000100:00100000:1.0:1788841330.193472:0:11140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa04b6d9e2a00 x1875735413512704/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788841330.193527:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6d9e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875735413512192:0@lo:400:kworker.0 00000100:00100000:1.0:1788841330.193624:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841330.193692:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788841330.193699:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6d9e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875735413512320:0@lo:400:kworker.0 00000100:00100000:1.0:1788841330.193734:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841330.193779:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413512192 00000100:00100000:1.0:1788841330.193790:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413512192 00000100:00100000:1.0:1788841330.193873:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788841330.193884:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6d9e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1875735413512192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841330.193946:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6d9e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1875735413512192:12345-0@lo:400:kworker.0 Request processed in 61us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841330.193954:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788841330.193983:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6d9e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875735413512448:0@lo:400:kworker.0 00000100:00100000:1.0:1788841330.194012:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841330.194029:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788841330.194035:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6d9e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875735413512832:0@lo:400:kworker.0 00000100:00100000:1.0:1788841330.194062:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841330.194094:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413512320 00000100:00100000:1.0:1788841330.194098:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413512320 00000100:00100000:1.0:1788841330.194124:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413512832 00000100:00100000:1.0:1788841330.194127:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413512832 00000100:00100000:1.0:1788841330.194142:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788841330.194148:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6d9e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875735413512320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841330.194188:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6d9e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875735413512320:12345-0@lo:400:kworker.0 Request processed in 41us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841330.194194:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788841330.194208:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788841330.194214:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6d9e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875735413512832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841330.194254:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6d9e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875735413512832:12345-0@lo:400:kworker.0 Request processed in 41us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841330.194260:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788841330.194298:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa04b6d9e3480 x1875735413512832/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788841330.194312:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6d9e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875735413512832:0@lo:400:kworker.0 00000100:00100000:1.0:1788841330.194337:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413512448 00000100:00100000:1.0:1788841330.194341:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413512448 00000100:00100000:1.0:1788841330.194358:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788841330.194363:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6d9e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875735413512448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841330.194397:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6d9e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875735413512448:12345-0@lo:400:kworker.0 Request processed in 33us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841330.194404:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788841330.194425:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6d9e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875735413512448:0@lo:400:kworker.0 00010000:00080000:1.0:1788841330.194446:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa04b6d9e1880 x1875735413512320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788841330.194454:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6d9e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875735413512320:0@lo:400:kworker.0 00000100:00100000:1.0:1788841330.194464:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6d9e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875735413512192:0@lo:400:kworker.0 00000100:00100000:2.0:1788841330.200515:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6d9e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875735413512576:0@lo:8:kworker.0 00000400:00000100:2.0:1788841330.200610:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875735413512576 offset 0 length 520: 4 00000100:00100000:2.0:1788841330.200812:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6d9e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875735413512704:0@lo:8:kworker.0 00000400:00000100:2.0:1788841330.200881:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875735413512704 offset 0 length 520: 4 00000100:00100000:0.0:1788841330.203612:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47ee5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+16:3650:x1875735413512064:12345-0@lo:400:kworker.0 Request processed in 13246us (13447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841330.203632:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788841330.203805:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6d9e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a456da20-a415-4617-896c-ee7aa5e4c089:3650:1875735413512064:0@lo:400:kworker.0 10000000:01000000:3.0:1788841330.574205:0:22769:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788841330.574225:0:22769:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa04b521ab000 from 13 10000000:01000000:3.0:1788841330.574231:0:22769:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788841330.574286:0:22769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b7a723400/0x5757cd208ac3826c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841330.574299:0:22769:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.107@tcp lock: ffffa04b7a723400/0x5757cd208ac3826c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841330.574319:0:22769:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.107@tcp lock: ffffa04b7a723400/0x5757cd208ac3826c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841330.574348:0:22769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413512960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788841330.574435:0:22769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841330.574481:0:22769:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b67752b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788841330.575470:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413512960 00000100:00100000:2.0:1788841330.575480:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413512960 00000100:00100000:2.0:1788841330.577108:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788841330.577126:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47ee5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+16:22769:x1875735413512960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788841330.577145:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841330.577168:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa04b81b5c000/0x5757cd208ac38273 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5757cd208ac3826c expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841330.577200:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa04b81b5c000/0x5757cd208ac38273 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5757cd208ac3826c expref: 17 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841330.577212:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa04b81b5c000/0x5757cd208ac38273 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5757cd208ac3826c expref: 17 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841330.577233:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04b81b5c000, rc 0) 00000100:00100000:2.0:1788841330.577310:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47ee5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+17:22769:x1875735413512960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 190us (2889us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841330.577483:0:22769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413512960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788841330.577501:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.107@tcp lock: ffffa04b7a723400/0x5757cd208ac3826c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac38273 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841330.577511:0:22769:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.107@tcp lock: ffffa04b7a723400/0x5757cd208ac3826c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5757cd208ac38273 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841330.577587:0:22769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413513088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788841330.577622:0:22769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841330.577655:0:22769:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b67752b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788841330.577669:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413513088 00000100:00100000:3.0:1788841330.577675:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413513088 00000100:00100000:3.0:1788841330.577700:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788841330.577707:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47ee7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+18:22769:x1875735413513088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788841330.577769:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788841330.577815:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47ee7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+17:22769:x1875735413513088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841330.577855:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788841330.577885:0:22769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413513088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788841330.577911:0:22769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413513216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788841330.577961:0:22769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841330.577980:0:22769:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b67752b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788841330.577991:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413513216 00000100:00100000:3.0:1788841330.577994:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413513216 00000100:00100000:3.0:1788841330.578013:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788841330.578018:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47ee6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+17:22769:x1875735413513216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788841330.578083:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47ee6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+17:22769:x1875735413513216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 64us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841330.578089:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788841330.578127:0:22769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413513216:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788841330.581703:0:23986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788841330.584342:0:22769:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788841330.584387:0:22769:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.107@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788841330.584399:0:22769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b7a723400/0x5757cd208ac3826c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac38273 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841330.584412:0:22769:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.107@tcp lock: ffffa04b7a723400/0x5757cd208ac3826c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac38273 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788841330.584424:0:22769:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788841330.584427:0:22769:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa04a45f80000 from 13 10000000:01000000:2.0:1788841330.584444:0:22769:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788841330.584487:0:22769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b81b5d800/0x5757cd208ac3827a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841330.584496:0:22769:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.107@tcp lock: ffffa04b81b5d800/0x5757cd208ac3827a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841330.584507:0:22769:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.107@tcp lock: ffffa04b81b5d800/0x5757cd208ac3827a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841330.584530:0:22769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b491d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413513344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788841330.584597:0:22769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841330.584642:0:22769:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b6e0203c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788841330.585658:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413513344 00000100:00100000:3.0:1788841330.585671:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413513344 00000100:00100000:3.0:1788841330.585742:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788841330.585753:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47ee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+17:22769:x1875735413513344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788841330.585770:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788841330.585787:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa04b7a723800/0x5757cd208ac38281 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5757cd208ac3827a expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841330.585815:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa04b7a723800/0x5757cd208ac38281 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5757cd208ac3827a expref: 18 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841330.585856:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa04b7a723800/0x5757cd208ac38281 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5757cd208ac3827a expref: 18 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841330.585866:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04b7a723800, rc 0) 00000100:00100000:3.0:1788841330.585935:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47ee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+18:22769:x1875735413513344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 185us (1337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841330.585955:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788841330.585992:0:22769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b491d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413513344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788841330.586010:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.107@tcp lock: ffffa04b81b5d800/0x5757cd208ac3827a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac38281 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841330.586019:0:22769:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.107@tcp lock: ffffa04b81b5d800/0x5757cd208ac3827a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5757cd208ac38281 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841330.586092:0:22769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c02b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413513472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788841330.586123:0:22769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841330.586159:0:22769:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b7fe02cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788841330.586245:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413513472 00000100:00100000:2.0:1788841330.586251:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413513472 00000100:00100000:2.0:1788841330.586285:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788841330.586292:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47ee4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+18:22769:x1875735413513472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788841330.586414:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47ee4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+18:22769:x1875735413513472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841330.586421:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788841330.586431:0:22769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c02b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413513472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788841330.586458:0:22769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c02b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413513600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788841330.586497:0:22769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841330.586526:0:22769:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b7fe02cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788841330.586565:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413513600 00000100:00100000:2.0:1788841330.586570:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413513600 00000100:00100000:2.0:1788841330.586603:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788841330.586611:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47ee5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+18:22769:x1875735413513600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788841330.586707:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47ee5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+18:22769:x1875735413513600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841330.586714:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788841330.587006:0:22769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c02b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413513600:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788841330.587777:0:23987:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788841330.588137:0:22769:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788841330.588170:0:22769:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.107@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788841330.588181:0:22769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b81b5d800/0x5757cd208ac3827a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac38281 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841330.588192:0:22769:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.107@tcp lock: ffffa04b81b5d800/0x5757cd208ac3827a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac38281 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841331.031924:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788841331.213385:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788841331.213429:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6d9e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875735413513728:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788841331.213591:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841331.213653:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413513728 00000100:00100000:1.0:1788841331.213663:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413513728 00000100:00100000:1.0:1788841331.213724:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788841331.213736:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6d9e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3652:x1875735413513728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788841331.213781:0:22777:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788841331.213864:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6d9e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3652:x1875735413513728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 130us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841331.213872:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788841331.213925:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6d9e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875735413513728:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788841331.218313:0:3648:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788841316/real 1788841316] req@ffffa04a47b45f80 x1875735413504640/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788841331 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841331.218378:0:3648:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa04a47b45f80 x1875735413504640/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788841331 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841331.218388:0:3648:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788841316/real 1788841316] req@ffffa04a47b44700 x1875735413504768/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788841331 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841331.218401:0:3648:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa04a47b44700 x1875735413504768/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788841331 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788841331.218428:0:3648:0:(import.c:65:import_set_state_nolock()) ffffa04b5210f000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788841331.218444:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788841331.218449:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47b45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875735413504640:0@lo:8:kworker.0 00000100:00080000:0.0:1788841331.218455:0:3648:0:(import.c:65:import_set_state_nolock()) ffffa04a47d02000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788841331.218460:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788841331.218463:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47b44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875735413504768:0@lo:8:kworker.0 00000100:00100000:1.0:1788841331.219396:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875735413513856:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788841331.219496:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841331.220188:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413513856 00000100:00100000:0.0:1788841331.220222:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413513856 00000100:00100000:0.0:1788841331.220293:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788841331.220304:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6d9e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875735413513856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788841331.220355:0:22777:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00080000:3.0:1788841331.220732:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788841331.220738:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788841331.220743:0:37:0:(import.c:65:import_set_state_nolock()) ffffa04b5210f000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788841331.220748:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 751 00000100:00080000:3.0:1788841331.220754:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788841331.220761:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffffa04b5210f000 using connection 192.168.204.107@tcp/0@lo 00000100:00100000:3.0:1788841331.220784:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa04b6e05ca80 x1875735413514112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788841331.220801:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788841331.220804:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788841331.220806:0:37:0:(import.c:65:import_set_state_nolock()) ffffa04a47d02000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788841331.220809:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 751 00000100:00080000:3.0:1788841331.220812:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788841331.220815:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa04a47d02000 using connection 192.168.204.107@tcp/0@lo 00000100:00100000:3.0:1788841331.220825:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa04b6e05e680 x1875735413514240/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788841331.220871:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788841331.220875:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788841331.220878:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788841331.220881:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788841331.221356:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875735413514368:0@lo:400:kworker.0 00000100:00100000:2.0:1788841331.221423:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841331.221465:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788841331.221471:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a456da20-a415-4617-896c-ee7aa5e4c089:3650:1875735413513984:0@lo:400:kworker.0 00000100:00100000:2.0:1788841331.221502:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841331.221569:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413513984 00000100:00100000:2.0:1788841331.221575:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413513984 00000100:00100000:2.0:1788841331.221623:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788841331.221633:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b4765f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+18:3650:x1875735413513984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841331.221682:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b4765f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+18:3650:x1875735413513984:12345-0@lo:400:kworker.0 Request processed in 51us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841331.221690:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788841331.221746:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a456da20-a415-4617-896c-ee7aa5e4c089:3650:1875735413513984:0@lo:400:kworker.0 00000100:00100000:0.0:1788841331.227315:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6d9e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875735413513856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 6995us (7801us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841331.227349:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788841331.227433:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875735413514112:0@lo:8:kworker.0 00000400:00000100:0.0:1788841331.227503:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875735413514112 offset 0 length 520: 4 00000100:00100000:0.0:1788841331.227737:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875735413514240:0@lo:8:kworker.0 00000400:00000100:0.0:1788841331.227762:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875735413514240 offset 0 length 520: 4 00000100:00100000:3.0:1788841331.227941:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875735413514496:0@lo:400:kworker.0 00000100:00100000:3.0:1788841331.228002:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841331.228161:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413514368 00000100:00100000:0.0:1788841331.228171:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413514368 00000100:00100000:0.0:1788841331.228243:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413514496 00000100:00100000:0.0:1788841331.228247:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413514496 00000100:00100000:0.0:1788841331.228267:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788841331.228277:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b491d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875735413514368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841331.228347:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b491d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875735413514368:12345-0@lo:400:kworker.0 Request processed in 71us (6924us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841331.228353:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788841331.228368:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788841331.228375:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6e05c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875735413514496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841331.228407:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6e05c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875735413514496:12345-0@lo:400:kworker.0 Request processed in 32us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841331.228413:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788841331.228464:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa04b6e05f480 x1875735413514368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841331.228483:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875735413514368:0@lo:400:kworker.0 00010000:00080000:3.0:1788841331.228624:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa04b6e05e300 x1875735413514496/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841331.228634:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875735413514496:0@lo:400:kworker.0 00000100:00100000:1.0:1788841331.232065:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875735413513856:0@lo:41:osp-pre-0-1.0 00000001:00100000:0.0:1788841331.734093:0:23506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788841332.050719:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788841333.008264:0:23525:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788841333.072440:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841334.096190:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841335.120305:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841336.144973:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788841336.333242:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b491d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a456da20-a415-4617-896c-ee7aa5e4c089:3652:1875735413514624:0@lo:400:kworker.0 00000100:00100000:1.0:1788841336.333321:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841336.333414:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413514624 00000100:00100000:3.0:1788841336.333422:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413514624 00000100:00100000:3.0:1788841336.333478:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788841336.333488:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b67a3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+18:3652:x1875735413514624:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788841336.333597:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788841336.333603:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788841336.333606:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788841336.333609:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788841336.337095:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b67a3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+18:3652:x1875735413514624:12345-0@lo:400:kworker.0 Request processed in 3595us (3761us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841336.337126:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788841336.337321:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b491d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875735413515008:0@lo:400:kworker.0 00000100:00100000:3.0:1788841336.337378:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841336.337408:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788841336.337414:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875735413515136:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788841336.337435:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841336.337470:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413515008 00000100:00100000:3.0:1788841336.337479:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413515008 00000100:00100000:3.0:1788841336.337508:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413515136 00000100:00100000:3.0:1788841336.337511:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413515136 00000100:00100000:3.0:1788841336.337523:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788841336.337530:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6e05f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3651:x1875735413515008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841336.337579:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6e05f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3651:x1875735413515008:12345-0@lo:400:kworker.0 Request processed in 49us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841336.337600:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788841336.337614:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788841336.337620:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6e05dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875735413515136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788841336.337645:0:22777:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788841336.337677:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6e05dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875735413515136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 57us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841336.337683:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788841336.337740:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875735413515136:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788841336.337762:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b491d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875735413515008:0@lo:400:kworker.0 00000100:00080000:2.0:1788841336.337865:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788841336.337875:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788841336.337878:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788841336.337881:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788841336.337915:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b491d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875735413514752:0@lo:400:kworker.0 00000100:00100000:2.0:1788841336.337944:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841336.337960:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b491d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875735413515264:0@lo:400:kworker.0 00000100:00100000:2.0:1788841336.337984:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841336.338006:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788841336.338013:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b491d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875735413514880:0@lo:400:kworker.0 00000100:00100000:2.0:1788841336.338036:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841336.338067:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413515264 00000100:00100000:2.0:1788841336.338070:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413515264 00000100:00100000:2.0:1788841336.338097:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413514880 00000100:00100000:2.0:1788841336.338100:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413514880 00000100:00100000:2.0:1788841336.338133:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788841336.338139:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b491d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875735413515264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841336.338175:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b491d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875735413515264:12345-0@lo:400:kworker.0 Request processed in 35us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841336.338181:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788841336.338194:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788841336.338200:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b491d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875735413514880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841336.338225:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b491d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875735413514880:12345-0@lo:400:kworker.0 Request processed in 26us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841336.338232:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1788841336.338268:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa04b491d3b80 x1875735413514880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841336.338286:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b491d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875735413514880:0@lo:400:kworker.0 00010000:00080000:2.0:1788841336.338299:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa04b491d1c00 x1875735413515264/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841336.338307:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b491d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875735413515264:0@lo:400:kworker.0 00000100:00100000:3.0:1788841336.338501:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413514752 00000100:00100000:3.0:1788841336.338506:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413514752 00000100:00100000:3.0:1788841336.338540:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788841336.338548:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b491d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875735413514752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841336.338579:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b491d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875735413514752:12345-0@lo:400:kworker.0 Request processed in 33us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841336.338585:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788841336.341145:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b491d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875735413514752:0@lo:400:kworker.0 00000100:00100000:2.0:1788841336.341995:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788841336.342011:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b491d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875735413515392:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788841336.342082:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841336.342139:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413515392 00000100:00100000:2.0:1788841336.342146:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413515392 00000100:00100000:2.0:1788841336.342191:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788841336.342200:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b491d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875735413515392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788841336.342234:0:22777:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788841336.342282:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b491d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875735413515392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841336.342290:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788841336.342332:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b491d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875735413515392:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788841336.343223:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b491d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a456da20-a415-4617-896c-ee7aa5e4c089:3652:1875735413514624:0@lo:400:kworker.0 00000020:01000004:3.0:1788841337.101911:0:24273:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788841337.101917:0:24273:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788841337.101918:0:24273:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788841337.102043:0:24273:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffffa04a45ff0800 00000020:01000004:3.0:1788841337.102061:0:24273:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788841337.102078:0:24273:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788841337.102111:0:24273:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffffa04b527d0000) 00000020:00000080:3.0:1788841337.102133:0:24273:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00010000:00010000:0.0:1788841337.173398:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1788841337.215247:0:24273:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788841337.216696:0:24273:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788841337.217548:0:24273:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788841337.219278:0:24273:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788841337.220452:0:24273:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788841337.221283:0:24273:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788841337.221602:0:24273:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:2.0:1788841337.227592:0:24273:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788841337.231699:0:24273:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788841337.233095:0:24273:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788841337.233118:0:24273:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5757cd208ac3828f 00000020:01000004:2.0:1788841337.233127:0:24273:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788841337.239109:0:24273:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.107@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788841337.239119:0:24273:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.107@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788841337.239131:0:24273:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788841337.239274:0:24273:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788841337.239295:0:24273:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffffa04b81afb370) 00000020:00000080:0.0:1788841337.239390:0:24273:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:0.0:1788841337.244907:0:24273:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788841337.245160:0:24273:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788841337.245168:0:24273:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788841337.249044:0:24273:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788841337.249064:0:24273:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788841337.251456:0:24273:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788841337.251473:0:24273:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788841337.259857:0:24273:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788841337.260763:0:24273:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788841337.260771:0:24273:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788841337.271298:0:24273:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788841337.271328:0:24273:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788841337.326514:0:24273:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788841337.327488:0:24273:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788841337.327496:0:24273:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788841337.335781:0:24273:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788841337.335969:0:24273:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788841337.337637:0:24273:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788841337.337651:0:24273:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788841337.340817:0:24273:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788841337.342995:0:24273:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788841337.343004:0:24273:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788841337.346797:0:24273:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788841337.346811:0:24273:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788841337.437485:0:24273:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788841337.438520:0:24273:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788841337.438530:0:24273:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788841337.441450:0:24273:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788841337.441464:0:24273:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788841337.443231:0:24273:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788841337.443264:0:24273:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1788841337.443272:0:24273:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.107@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788841337.454005:0:24273:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.107@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788841337.454055:0:24273:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.107@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788841337.454060:0:24273:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788841337.454062:0:24273:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788841337.454063:0:24273:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788841337.454065:0:24273:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788841337.454066:0:24273:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788841337.454068:0:24273:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788841337.454070:0:24273:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788841337.454072:0:24273:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788841337.454073:0:24273:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788841337.454078:0:24273:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788841337.454080:0:24273:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788841337.454119:0:24273:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788841337.454120:0:24273:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788841337.454121:0:24273:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788841337.454122:0:24273:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788841337.454123:0:24273:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788841337.454124:0:24273:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788841337.454125:0:24273:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788841337.454126:0:24273:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788841337.454209:0:24273:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788841337.454233:0:24273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:24273:1875735413515520:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788841337.454959:0:24273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841337.455006:0:24273:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b5f7f1240 going to sleep for 11 seconds 00000100:00100000:0.0:1788841337.455027:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413515520 00000100:00100000:0.0:1788841337.455035:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413515520 00000100:00100000:0.0:1788841337.455103:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788841337.455114:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b67a38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+18:24273:x1875735413515520:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788841337.455243:0:22764:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788841337.455247:0:22764:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788841337.455252:0:22764:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788841337.455627:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b67a38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+18:24273:x1875735413515520:12345-0@lo:253:mount.lustre.0 Request processed in 514us (1315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841337.455635:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788841337.455748:0:24273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:24273:1875735413515520:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788841337.455770:0:24273:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788841337.455774:0:24273:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788841337.455775:0:24273:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788841337.455777:0:24273:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788841337.455778:0:24273:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788841337.455779:0:24273:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788841337.455780:0:24273:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788841337.455781:0:24273:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788841337.455783:0:24273:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788841337.455785:0:24273:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788841337.455804:0:24273:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa04a45ff0800 from lustre-OST0000 10000000:01000000:3.0:1788841337.455830:0:24273:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788841337.455896:0:24273:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788841337.455904:0:24273:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffffa04b6e03cd28 local copy 00010000:00010000:3.0:1788841337.455915:0:24273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04a474afa00/0x5757cd208ac3804a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac38051 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841337.456020:0:24273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:24273:1875735413515648:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788841337.456059:0:24273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841337.456108:0:24273:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b5f7f1d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788841337.456158:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413515648 00000100:00100000:2.0:1788841337.456164:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413515648 00000100:00100000:2.0:1788841337.456201:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788841337.456210:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b67a3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+18:24273:x1875735413515648:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788841337.456277:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b67a3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+18:24273:x1875735413515648:12345-0@lo:501:mount.lustre.0 Request processed in 69us (218us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788841337.456284:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788841337.456289:0:24273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:24273:1875735413515648:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788841337.456301:0:24273:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.107@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788841337.456317:0:24273:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.107@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788841337.456323:0:24273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04a474afa00/0x5757cd208ac3804a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac38051 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841337.456331:0:24273:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.107@tcp lock: ffffa04a474afa00/0x5757cd208ac3804a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac38051 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788841337.456354:0:24273:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa04a45ff0800 10000000:01000000:3.0:1788841337.456363:0:24273:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788841337.456368:0:24273:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788841337.456371:0:24273:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788841337.456376:0:24273:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788841337.456379:0:24273:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788841337.456400:0:24273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b7a723e00/0x5757cd208ac3829d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841337.456408:0:24273:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.107@tcp lock: ffffa04b7a723e00/0x5757cd208ac3829d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841337.456418:0:24273:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.107@tcp lock: ffffa04b7a723e00/0x5757cd208ac3829d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841337.456432:0:24273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:24273:1875735413515776:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788841337.456458:0:24273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841337.456479:0:24273:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b5f7f1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788841337.456819:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413515776 00000100:00100000:0.0:1788841337.456824:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413515776 00000100:00100000:0.0:1788841337.456877:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788841337.456885:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b67a38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+18:24273:x1875735413515776:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788841337.456903:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841337.456915:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa04a474af200/0x5757cd208ac382a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5757cd208ac3829d expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841337.456938:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa04a474af200/0x5757cd208ac382a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5757cd208ac3829d expref: 19 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841337.456948:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa04a474af200/0x5757cd208ac382a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5757cd208ac3829d expref: 19 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841337.456956:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04a474af200, rc 0) 00000100:00100000:0.0:1788841337.457002:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b67a38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+19:24273:x1875735413515776:12345-0@lo:101:mount.lustre.0 Request processed in 119us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841337.457008:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788841337.457060:0:24273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:24273:1875735413515776:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788841337.457073:0:24273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.107@tcp lock: ffffa04b7a723e00/0x5757cd208ac3829d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac382a4 expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841337.457094:0:24273:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.107@tcp lock: ffffa04b7a723e00/0x5757cd208ac3829d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5757cd208ac382a4 expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788841337.459495:0:24273:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:3.0:1788841337.460122:0:24273:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788841337.462107:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1788841337.462224:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1788841337.462245:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1788841337.462259:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1788841337.462285:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1788841337.462298:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1788841337.462388:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1788841337.462407:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1788841337.462421:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:3.0:1788841337.462435:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:3.0:1788841337.462448:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:3.0:1788841337.462459:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:3.0:1788841337.462481:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:3.0:1788841337.462487:0:24273:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:3.0:1788841337.462593:0:24273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:24273:1875735413515904:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788841337.462678:0:24273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841337.462724:0:24273:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b5f7f1540 going to sleep for 11 seconds 00000100:00100000:2.0:1788841337.462794:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413515904 00000100:00100000:2.0:1788841337.462802:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413515904 00000100:00100000:3.0:1788841337.462987:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788841337.462999:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b67a39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+19:24273:x1875735413515904:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788841337.463266:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b67a39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+19:24273:x1875735413515904:12345-0@lo:501:mount.lustre.0 Request processed in 268us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841337.463274:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788841337.463416:0:24273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:24273:1875735413515904:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788841337.463453:0:24273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c02b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:24273:1875735413516032:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788841337.463497:0:24273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841337.463529:0:24273:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b7fe02900 going to sleep for 11 seconds 00000100:00100000:2.0:1788841337.463588:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413516032 00000100:00100000:2.0:1788841337.463593:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413516032 00000100:00100000:2.0:1788841337.463657:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788841337.463665:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b67a3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+19:24273:x1875735413516032:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788841337.464828:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b67a3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+19:24273:x1875735413516032:12345-0@lo:503:mount.lustre.0 Request processed in 906us (1073us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841337.464878:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788841337.464978:0:24273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c02b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:24273:1875735413516032:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788841337.465609:0:24273:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788841337.465708:0:24273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c02b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:24273:1875735413516160:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788841337.465761:0:24273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841337.465805:0:24273:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b7fe02900 going to sleep for 11 seconds 00000100:00100000:1.0:1788841337.465929:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413516160 00000100:00100000:1.0:1788841337.465942:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413516160 00000100:00100000:1.0:1788841337.466215:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788841337.466226:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47cca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+19:24273:x1875735413516160:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788841337.466700:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47cca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+19:24273:x1875735413516160:12345-0@lo:502:mount.lustre.0 Request processed in 475us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841337.466707:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788841337.466788:0:24273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c02b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:24273:1875735413516160:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788841337.467017:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1788841337.467040:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:0.0:1788841337.467058:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:0.0:1788841337.467068:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:0.0:1788841337.467078:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:0.0:1788841337.467101:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:0.0:1788841337.467112:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:0.0:1788841337.467121:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:0.0:1788841337.467131:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:0.0:1788841337.467141:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:0.0:1788841337.467165:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:0.0:1788841337.467180:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:0.0:1788841337.467295:0:24273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c02b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:24273:1875735413516288:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788841337.467423:0:24273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841337.467454:0:24273:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b7fe02900 going to sleep for 11 seconds 00000100:00100000:3.0:1788841337.467459:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413516288 00000100:00100000:3.0:1788841337.467465:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413516288 00000100:00100000:0.0:1788841337.467726:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788841337.467734:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47ccac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+19:24273:x1875735413516288:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788841337.467849:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47ccac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+19:24273:x1875735413516288:12345-0@lo:502:mount.lustre.0 Request processed in 101us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841337.467857:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788841337.467906:0:24273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c02b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:24273:1875735413516288:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788841337.467974:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:0.0:1788841337.467985:0:24273:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1788841337.468801:0:24290:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788841337.468811:0:24290:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1788841337.468819:0:24290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788841337.468821:0:24290:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788841337.468828:0:24290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788841337.469489:0:24290:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffffa04b46deb370) 00000020:00000080:0.0:1788841337.469519:0:24290:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788841337.469529:0:24290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788841337.469623:0:24290:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa04a45ff0800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788841337.469633:0:24290:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788841337.469646:0:24290:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5757cd208ac382b2 00010000:00010000:0.0:1788841337.474544:0:24290:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:0.0:1788841337.475044:0:24290:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:0.0:1788841337.476640:0:24290:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:1.0:1788841337.478005:0:24290:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788841337.478016:0:24290:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788841337.478023:0:24290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788841337.478026:0:24290:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788841337.478030:0:24290:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788841337.478033:0:24290:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1788841337.478035:0:24290:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788841337.478037:0:24290:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788841337.478038:0:24290:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788841337.478040:0:24290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788841337.478042:0:24290:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788841337.478045:0:24290:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788841337.478047:0:24290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788841337.478049:0:24290:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788841337.478052:0:24290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788841337.478053:0:24290:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788841337.478056:0:24290:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788841337.478058:0:24290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788841337.478059:0:24290:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788841337.478061:0:24290:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788841337.478063:0:24290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788841337.478065:0:24290:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788841337.478068:0:24290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788841337.478108:0:24290:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788841337.478112:0:24290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788841337.478113:0:24290:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788841337.478117:0:24290:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:2.0:1788841337.480108:0:24273:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788841337.480157:0:24273:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.107@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788841337.480180:0:24273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b7a723e00/0x5757cd208ac3829d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac382a4 expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841337.480201:0:24273:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.107@tcp lock: ffffa04b7a723e00/0x5757cd208ac3829d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac382a4 expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788841337.480209:0:24273:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa04a45ff0800 from 1 10000000:01000000:2.0:1788841337.480212:0:24273:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788841337.480252:0:24273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b81b5c400/0x5757cd208ac382b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841337.480260:0:24273:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.107@tcp lock: ffffa04b81b5c400/0x5757cd208ac382b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841337.480271:0:24273:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.107@tcp lock: ffffa04b81b5c400/0x5757cd208ac382b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841337.480298:0:24273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b491d2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:24273:1875735413516416:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788841337.480470:0:24273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841337.480519:0:24273:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b6e035600 going to sleep for 11 seconds 00000100:00100000:3.0:1788841337.480585:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413516416 00000100:00100000:3.0:1788841337.480593:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413516416 00000100:00100000:3.0:1788841337.480686:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788841337.480697:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47cc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+19:24273:x1875735413516416:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788841337.480710:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788841337.480723:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa04b7a722e00/0x5757cd208ac382c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5757cd208ac382b9 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841337.480761:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa04b7a722e00/0x5757cd208ac382c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5757cd208ac382b9 expref: 20 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841337.480774:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa04b7a722e00/0x5757cd208ac382c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5757cd208ac382b9 expref: 20 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841337.480783:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04b7a722e00, rc 0) 00000100:00100000:3.0:1788841337.480870:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47cc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+20:24273:x1875735413516416:12345-0@lo:101:mount.lustre.0 Request processed in 175us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841337.480877:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788841337.481045:0:24273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b491d2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:24273:1875735413516416:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788841337.481063:0:24273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.107@tcp lock: ffffa04b81b5c400/0x5757cd208ac382b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac382c0 expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841337.481074:0:24273:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.107@tcp lock: ffffa04b81b5c400/0x5757cd208ac382b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5757cd208ac382c0 expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788841337.482606:0:24273:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:0.0:1788841337.483078:0:24273:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788841337.483421:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1788841337.483447:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1788841337.483460:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1788841337.483472:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1788841337.483485:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1788841337.483498:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1788841337.483510:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1788841337.483523:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:0.0:1788841337.483537:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1788841337.483552:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:0.0:1788841337.483566:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:0.0:1788841337.483583:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:0.0:1788841337.483589:0:24273:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:0.0:1788841337.483668:0:24273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c02b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:24273:1875735413516544:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788841337.483734:0:24273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841337.483861:0:24273:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b43380840 going to sleep for 11 seconds 00000100:00100000:3.0:1788841337.483922:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413516544 00000100:00100000:3.0:1788841337.483931:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413516544 00000100:00100000:3.0:1788841337.484027:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788841337.484037:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47cc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+20:24273:x1875735413516544:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788841337.484200:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47cc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+20:24273:x1875735413516544:12345-0@lo:501:mount.lustre.0 Request processed in 163us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841337.484208:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788841337.484410:0:24273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c02b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:24273:1875735413516544:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788841337.484443:0:24273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c02b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:24273:1875735413516672:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788841337.484483:0:24273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841337.484655:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413516672 00000100:00100000:3.0:1788841337.484660:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413516672 00000100:00100000:0.0:1788841337.484663:0:24273:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b43380840 going to sleep for 11 seconds 00000100:00100000:3.0:1788841337.484682:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788841337.484689:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47cc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+20:24273:x1875735413516672:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788841337.484862:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47cc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+20:24273:x1875735413516672:12345-0@lo:503:mount.lustre.0 Request processed in 173us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841337.484868:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788841337.484936:0:24273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c02b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:24273:1875735413516672:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788841337.485510:0:24273:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788841337.485602:0:24273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c02b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:24273:1875735413516800:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788841337.485661:0:24273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841337.485743:0:24273:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b43380840 going to sleep for 11 seconds 00000100:00100000:2.0:1788841337.485788:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413516800 00000100:00100000:2.0:1788841337.485794:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413516800 00000100:00100000:3.0:1788841337.488255:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788841337.488272:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47cca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+20:24273:x1875735413516800:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788841337.488462:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47cca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+20:24273:x1875735413516800:12345-0@lo:502:mount.lustre.0 Request processed in 196us (2800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841337.488470:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788841337.488662:0:24273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c02b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:24273:1875735413516800:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788841337.488940:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1788841337.488971:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:1.0:1788841337.488993:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:1.0:1788841337.489010:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:1.0:1788841337.489024:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:1.0:1788841337.489038:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:1.0:1788841337.489052:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:1.0:1788841337.489063:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:1.0:1788841337.489075:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:1.0:1788841337.489101:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:1.0:1788841337.489114:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:1.0:1788841337.489213:0:24273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6d9e0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:24273:1875735413516928:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788841337.489261:0:24273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841337.489305:0:24273:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b67752000 going to sleep for 11 seconds 00000100:00100000:3.0:1788841337.489419:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413516928 00000100:00100000:3.0:1788841337.489425:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413516928 00000100:00100000:3.0:1788841337.489471:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788841337.489479:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47ccb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+20:24273:x1875735413516928:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788841337.489561:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47ccb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+20:24273:x1875735413516928:12345-0@lo:502:mount.lustre.0 Request processed in 82us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841337.489568:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788841337.489652:0:24273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6d9e0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:24273:1875735413516928:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788841337.489701:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:0.0:1788841337.489710:0:24273:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788841337.490546:0:24294:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788841337.490555:0:24294:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788841337.490558:0:24294:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788841337.490564:0:24294:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa04a45ff0800 00000020:00000080:3.0:1788841337.490567:0:24294:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788841337.490574:0:24294:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788841337.490576:0:24294:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788841337.490578:0:24294:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788841337.490580:0:24294:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788841337.490582:0:24294:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788841337.490584:0:24294:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788841337.490587:0:24294:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa04a45ff0800 00000020:00000080:3.0:1788841337.490588:0:24294:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788841337.490639:0:24294:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788841337.490642:0:24294:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788841337.490644:0:24294:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788841337.490646:0:24294:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788841337.490648:0:24294:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788841337.490649:0:24294:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788841337.490652:0:24294:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa04a45ff0800 00000020:00000080:3.0:1788841337.490662:0:24294:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788841337.490680:0:24294:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788841337.490682:0:24294:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788841337.490683:0:24294:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788841337.490686:0:24294:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788841337.490688:0:24294:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788841337.490689:0:24294:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788841337.490692:0:24294:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa04a45ff0800 00000020:00000080:3.0:1788841337.490694:0:24294:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788841337.490713:0:24294:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788841337.490716:0:24294:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788841337.490717:0:24294:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788841337.490720:0:24294:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:0.0:1788841337.491241:0:24273:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788841337.491265:0:24273:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.107@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788841337.491286:0:24273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b81b5c400/0x5757cd208ac382b9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac382c0 expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841337.491298:0:24273:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.107@tcp lock: ffffa04b81b5c400/0x5757cd208ac382b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac382c0 expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788841337.491442:0:24273:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788841337.491445:0:24273:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa04a45ff0800 10000000:01000000:0.0:1788841337.491448:0:24273:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa04a45ff0800 10000000:01000000:0.0:1788841337.491451:0:24273:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788841337.491457:0:24273:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa04a45ff0800 from 1 10000000:01000000:0.0:1788841337.491460:0:24273:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788841337.491492:0:24273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04a474afc00/0x5757cd208ac382c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841337.491500:0:24273:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.107@tcp lock: ffffa04a474afc00/0x5757cd208ac382c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841337.491511:0:24273:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.107@tcp lock: ffffa04a474afc00/0x5757cd208ac382c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841337.491532:0:24273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c02a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:24273:1875735413517056:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788841337.491605:0:24273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841337.493039:0:24273:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b43380c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788841337.493278:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413517056 00000100:00100000:3.0:1788841337.493287:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413517056 00000100:00100000:3.0:1788841337.493346:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788841337.493357:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47ccb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+20:24273:x1875735413517056:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788841337.493374:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788841337.493392:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa04b7a722c00/0x5757cd208ac382ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5757cd208ac382c7 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841337.493422:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa04b7a722c00/0x5757cd208ac382ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5757cd208ac382c7 expref: 21 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841337.493434:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa04b7a722c00/0x5757cd208ac382ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5757cd208ac382c7 expref: 21 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841337.493442:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04b7a722c00, rc 0) 00000100:00100000:3.0:1788841337.493499:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47ccb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+21:24273:x1875735413517056:12345-0@lo:101:mount.lustre.0 Request processed in 144us (1893us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841337.493505:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788841337.493614:0:24273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c02a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:24273:1875735413517056:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788841337.493630:0:24273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.107@tcp lock: ffffa04a474afc00/0x5757cd208ac382c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac382ce expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841337.493639:0:24273:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.107@tcp lock: ffffa04a474afc00/0x5757cd208ac382c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5757cd208ac382ce expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788841337.503384:0:24273:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:2.0:1788841337.503783:0:24273:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788841337.504105:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1788841337.504131:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1788841337.504271:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1788841337.504286:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1788841337.504299:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1788841337.504385:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1788841337.504404:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1788841337.504420:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1788841337.504434:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1788841337.504448:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1788841337.504462:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1788841337.504476:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1788841337.504489:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1788841337.504501:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1788841337.504513:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1788841337.504525:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1788841337.504538:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1788841337.504552:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1788841337.504564:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1788841337.504577:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1788841337.504589:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1788841337.504603:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1788841337.504615:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1788841337.504628:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1788841337.504642:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:2.0:1788841337.504655:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:2.0:1788841337.504667:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:2.0:1788841337.504680:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:2.0:1788841337.504692:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:2.0:1788841337.504704:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:2.0:1788841337.504793:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:2.0:1788841337.504805:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:2.0:1788841337.504817:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:2.0:1788841337.504896:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:2.0:1788841337.504910:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:2.0:1788841337.504920:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:2.0:1788841337.504943:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:2.0:1788841337.504955:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:2.0:1788841337.504966:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:2.0:1788841337.504978:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:2.0:1788841337.504990:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:2.0:1788841337.505002:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:2.0:1788841337.505013:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:2.0:1788841337.505024:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:2.0:1788841337.505035:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:2.0:1788841337.505046:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:2.0:1788841337.505057:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:2.0:1788841337.505068:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:2.0:1788841337.505385:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:2.0:1788841337.505406:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:2.0:1788841337.505422:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:2.0:1788841337.505427:0:24273:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:2.0:1788841337.505527:0:24273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b491d2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:24273:1875735413517184:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788841337.505592:0:24273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841337.505683:0:24273:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b6e035780 going to sleep for 11 seconds 00000100:00100000:1.0:1788841337.509981:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413517184 00000100:00100000:1.0:1788841337.509998:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413517184 00000100:00100000:1.0:1788841337.511257:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788841337.511272:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47cc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+21:24273:x1875735413517184:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788841337.511462:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47cc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+21:24273:x1875735413517184:12345-0@lo:501:mount.lustre.0 Request processed in 193us (5868us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841337.511470:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788841337.514098:0:24273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b491d2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:24273:1875735413517184:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788841337.514868:0:24273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b491d2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:24273:1875735413517312:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788841337.514950:0:24273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841337.515185:0:24273:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b6e035780 going to sleep for 11 seconds 00000100:00100000:0.0:1788841337.515207:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413517312 00000100:00100000:0.0:1788841337.515213:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413517312 00000100:00100000:0.0:1788841337.515264:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788841337.515273:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47ccb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+21:24273:x1875735413517312:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788841337.515395:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47ccb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+21:24273:x1875735413517312:12345-0@lo:503:mount.lustre.0 Request processed in 122us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841337.515403:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788841337.515616:0:24273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b491d2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:24273:1875735413517312:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788841337.516241:0:24273:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788841337.516319:0:24273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6d9e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:24273:1875735413517440:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788841337.516368:0:24273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841337.516438:0:24273:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b429d8600 going to sleep for 11 seconds 00000100:00100000:3.0:1788841337.516495:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413517440 00000100:00100000:3.0:1788841337.516501:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413517440 00000100:00100000:3.0:1788841337.516634:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788841337.516644:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47cc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+21:24273:x1875735413517440:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788841337.516752:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47cc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+21:24273:x1875735413517440:12345-0@lo:502:mount.lustre.0 Request processed in 109us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841337.516760:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788841337.516852:0:24273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6d9e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:24273:1875735413517440:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788841337.517026:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1788841337.517051:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1788841337.517063:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1788841337.517076:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1788841337.517103:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1788841337.517132:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1788841337.517149:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1788841337.517163:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1788841337.517177:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1788841337.517190:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1788841337.517203:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1788841337.517217:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1788841337.517231:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1788841337.517243:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1788841337.517257:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1788841337.517271:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1788841337.517286:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1788841337.517299:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1788841337.517311:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1788841337.517325:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1788841337.517337:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1788841337.517365:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1788841337.517382:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1788841337.517396:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1788841337.517410:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:1.0:1788841337.517421:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:1.0:1788841337.517438:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:1.0:1788841337.517452:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:1.0:1788841337.517465:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:1.0:1788841337.517479:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:1.0:1788841337.517492:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:1.0:1788841337.517517:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:1.0:1788841337.517546:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:1.0:1788841337.517563:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:1.0:1788841337.517575:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:1.0:1788841337.517586:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:1.0:1788841337.517597:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:1.0:1788841337.517624:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:1.0:1788841337.517638:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:1.0:1788841337.517650:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:1.0:1788841337.517663:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:1.0:1788841337.517678:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:1.0:1788841337.517691:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:1.0:1788841337.517704:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:1.0:1788841337.517716:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:1.0:1788841337.517729:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:1.0:1788841337.517741:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:1.0:1788841337.517753:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:1.0:1788841337.517794:0:24273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6d9e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:24273:1875735413517568:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788841337.517868:0:24273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841337.518058:0:24273:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b429d8600 going to sleep for 11 seconds 00000100:00100000:0.0:1788841337.518103:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413517568 00000100:00100000:0.0:1788841337.518109:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413517568 00000100:00100000:0.0:1788841337.518142:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788841337.518149:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47ccbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+21:24273:x1875735413517568:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788841337.518292:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47ccbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+21:24273:x1875735413517568:12345-0@lo:502:mount.lustre.0 Request processed in 142us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841337.518299:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788841337.518390:0:24273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6d9e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:24273:1875735413517568:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788841337.518527:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:1.0:1788841337.518613:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:1.0:1788841337.518632:0:24273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6d9e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:24273:1875735413517696:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788841337.518668:0:24273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841337.518718:0:24273:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b429d8600 going to sleep for 11 seconds 00000100:00100000:0.0:1788841337.518752:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413517696 00000100:00100000:0.0:1788841337.518756:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413517696 00000100:00100000:0.0:1788841337.518813:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788841337.518827:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47cc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+21:24273:x1875735413517696:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788841337.519015:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47cc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+21:24273:x1875735413517696:12345-0@lo:502:mount.lustre.0 Request processed in 188us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841337.519022:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788841337.519129:0:24273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6d9e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:24273:1875735413517696:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788841337.519166:0:24273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:1.0:1788841337.519174:0:24273:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788841337.519997:0:24299:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788841337.520014:0:24299:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffffa04b46de99b8) 00000020:00000080:0.0:1788841337.520039:0:24299:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1788841337.522982:0:24299:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa04a45ff0800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788841337.522993:0:24299:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa04a45ff0800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788841337.522996:0:24299:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa04a45ff0800 3 00010000:00080000:0.0:1788841337.523036:0:24299:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa04a4784f800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.107@tcp at head 00010000:00010000:0.0:1788841337.525134:0:24299:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1788841337.525384:0:24299:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788841337.525425:0:24299:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788841337.525437:0:24299:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x5757cd208ac382dc 00000100:00080000:0.0:1788841337.525448:0:24299:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788841337.525454:0:24299:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffffa04a4784f800 using connection 192.168.204.107@tcp/0@lo 00000100:00100000:0.0:1788841337.525490:0:24299:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa04b7c02a300 x1875735413517824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788841337.527223:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c02a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1875735413517824:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788841337.527407:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788841337.527480:0:24299:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788841337.527563:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413517824 00000100:00080000:3.0:1788841337.527566:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788841337.527570:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788841337.527573:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:2.0:1788841337.527573:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413517824 00000100:00080000:3.0:1788841337.527576:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788841337.527600:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788841337.527603:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788841337.527606:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:2.0:1788841337.527607:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788841337.527609:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788841337.527615:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7c028e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1875735413517824:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788841337.527656:0:22774:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 771 last 0 00000020:00000080:2.0:1788841337.527708:0:22774:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5757cd208ac382e3 00000004:00100000:2.0:1788841337.527728:0:22774:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788841337.527764:0:22774:0:(import.c:65:import_set_state_nolock()) ffffa04a47d94000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788841337.527819:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7c028e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875735413517824:12345-0@lo:38:llog_process_th.0 Request processed in 203us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841337.527826:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788841337.527976:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875735413518080:0@lo:400:kworker.0 00000100:00100000:3.0:1788841337.528009:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841337.528036:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788841337.528042:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875735413517952:0@lo:400:kworker.0 00000100:00100000:3.0:1788841337.528063:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841337.528101:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875735413518208:0@lo:400:kworker.0 00000100:00100000:3.0:1788841337.528123:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841337.528151:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788841337.528156:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875735413518336:0@lo:400:kworker.0 00000100:00100000:3.0:1788841337.528185:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841337.528215:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413517952 00000100:00100000:3.0:1788841337.528220:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413517952 00010000:00080000:0.0:1788841337.528230:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa04b7c02a300 x1875735413517824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788841347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841337.528239:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413518208 00000100:00100000:3.0:1788841337.528241:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413518208 00000100:00100000:0.0:1788841337.528241:0:3648:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788841337.528250:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00100000:3.0:1788841337.528252:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1788841337.528257:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00100000:3.0:1788841337.528258:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6e05f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875735413517952:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788841337.528266:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788841337.528268:0:3648:0:(import.c:65:import_set_state_nolock()) ffffa04a4784f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788841337.528274:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c02a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1875735413517824:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788841337.528295:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6e05f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875735413517952:12345-0@lo:400:kworker.0 Request processed in 37us (230us total) trans 0 rc 0/0 00000020:01000004:0.0:1788841337.528388:0:24299:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788841337.528404:0:24299:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffffa04b46decd28) 00000020:00000080:0.0:1788841337.528422:0:24299:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:0.0:1788841337.528513:0:24299:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa04a45ff0800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788841337.528519:0:24299:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa04a45ff0800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788841337.528523:0:24299:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa04a45ff0800 3 00000100:00100000:3.0:1788841337.528580:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788841337.528599:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788841337.528605:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6e05c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875735413518208:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1788841337.528617:0:24299:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa04a47848000@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.107@tcp at head 00000100:00100000:3.0:1788841337.528641:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6e05c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875735413518208:12345-0@lo:400:kworker.0 Request processed in 36us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841337.528964:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788841337.529004:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875735413517952:0@lo:400:kworker.0 00000100:00100000:3.0:1788841337.529026:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875735413518208:0@lo:400:kworker.0 00000100:00100000:3.0:1788841337.529041:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413518080 00000100:00100000:3.0:1788841337.529044:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413518080 00000100:00100000:3.0:1788841337.529067:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413518336 00000100:00100000:3.0:1788841337.529070:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413518336 00000100:00100000:3.0:1788841337.529094:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788841337.529101:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6e05d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875735413518080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841337.529260:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6e05d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875735413518080:12345-0@lo:400:kworker.0 Request processed in 159us (1249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841337.529267:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788841337.529285:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788841337.529291:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7fb86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875735413518336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841337.529405:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7fb86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875735413518336:12345-0@lo:400:kworker.0 Request processed in 113us (1217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841337.529412:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788841337.529441:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa04b6e05e300 x1875735413518336/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841337.529452:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875735413518336:0@lo:400:kworker.0 00010000:00080000:3.0:1788841337.529473:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa04b6e05ea00 x1875735413518080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841337.529482:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875735413518080:0@lo:400:kworker.0 00010000:00010000:0.0:1788841337.531254:0:24299:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:0.0:1788841337.531467:0:24299:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1788841337.531505:0:24299:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788841337.531515:0:24299:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x5757cd208ac382f1 00000100:00080000:0.0:1788841337.531524:0:24299:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788841337.532366:0:24299:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffffa04a47848000 using connection 192.168.204.107@tcp/0@lo 00000100:00100000:0.0:1788841337.532405:0:24299:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa04b7c02a300 x1875735413518464/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788841337.532437:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c02a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3648:1875735413518464:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788841337.532509:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788841337.532607:0:24299:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788841337.532628:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788841337.532633:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788841337.532637:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788841337.532640:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788841337.532651:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788841337.532653:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788841337.532656:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788841337.532659:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788841337.535953:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413518464 00000100:00100000:2.0:1788841337.535969:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413518464 00000100:00100000:0.0:1788841337.536163:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788841337.536172:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7c02ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1875735413518464:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788841337.536202:0:22774:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 771 last 0 00000020:00000080:0.0:1788841337.536238:0:22774:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x5757cd208ac382f8 00000004:00100000:0.0:1788841337.536253:0:22774:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788841337.536286:0:22774:0:(import.c:65:import_set_state_nolock()) ffffa04a4784e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788841337.536369:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7c02ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875735413518464:12345-0@lo:38:llog_process_th.0 Request processed in 196us (3859us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841337.536376:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788841337.536422:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa04b7c02a300 x1875735413518464/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788841347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841337.536435:0:3648:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788841337.536443:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:0.0:1788841337.536451:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788841337.536455:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788841337.536458:0:3648:0:(import.c:65:import_set_state_nolock()) ffffa04a47848000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788841337.536464:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c02a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3648:1875735413518464:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788841337.537035:0:24299:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:1.0:1788841337.537107:0:24273:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788841337.537135:0:24273:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.107@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788841337.537150:0:24273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04a474afc00/0x5757cd208ac382c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac382ce expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841337.537160:0:24273:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.107@tcp lock: ffffa04a474afc00/0x5757cd208ac382c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac382ce expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788841337.537205:0:24273:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788841337.537207:0:24273:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788841337.537209:0:24273:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788841337.537210:0:24273:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788841337.537211:0:24273:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788841337.537212:0:24273:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788841337.537214:0:24273:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788841337.537216:0:24273:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788841337.537217:0:24273:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788841337.537221:0:24273:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788841337.537224:0:24273:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788841337.537225:0:24273:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788841337.537226:0:24273:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788841337.537227:0:24273:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788841337.537229:0:24273:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788841337.537230:0:24273:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788841337.537231:0:24273:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788841337.537232:0:24273:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788841337.537233:0:24273:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788841337.537253:0:24273:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788841337.537271:0:24273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6d9e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:24273:1875735413518592:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788841337.537322:0:24273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841337.537355:0:24273:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b429d8840 going to sleep for 11 seconds 00000100:00100000:3.0:1788841337.538003:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413518592 00000100:00100000:3.0:1788841337.538010:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413518592 00000100:00100000:3.0:1788841337.538058:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788841337.538067:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47cc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+21:24273:x1875735413518592:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788841337.538103:0:22767:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788841337.538116:0:22767:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788841337.543822:0:22767:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788841337.543900:0:22767:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788841337.544342:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47cc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+21:24273:x1875735413518592:12345-0@lo:253:mount.lustre.0 Request processed in 6271us (7014us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841337.544366:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788841337.544409:0:24273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6d9e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:24273:1875735413518592:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788841337.544424:0:24273:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788841337.544434:0:24273:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788841337.544435:0:24273:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788841337.544437:0:24273:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788841337.544438:0:24273:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788841337.544439:0:24273:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788841337.544441:0:24273:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788841337.544442:0:24273:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788841337.544444:0:24273:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788841337.544446:0:24273:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788841337.544462:0:24273:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1788841337.544545:0:22788:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788841337.544549:0:22788:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788841337.544647:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa04b7a723c00/0x5757cd208ac382ff lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841337.545534:0:22788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa04b48dc6400/0x5757cd208ac38249 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5757cd208ac38242 expref: 20 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841337.545543:0:22788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa04b48dc7c00/0x5757cd208ac38257 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5757cd208ac38250 expref: 20 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841337.545550:0:22788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa04b7a723c00/0x5757cd208ac382ff lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841337.545601:0:22788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa04b48dc7c00/0x5757cd208ac38257 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5757cd208ac38250 expref: 20 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841337.545617:0:22788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa04b48dc7c00/0x5757cd208ac38257 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5757cd208ac38250 expref: 20 pid: 22767 timeout: 871 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841337.545632:0:22788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fb86d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22788:1875735413518720:0@lo:104: 00000100:00100000:3.0:1788841337.545689:0:22788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00000004:2.0:1788841337.547052:0:24273:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00010000:00010000:3.0:1788841337.547259:0:22788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa04b48dc6400/0x5757cd208ac38249 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5757cd208ac38242 expref: 20 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841337.547271:0:22788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa04b48dc6400/0x5757cd208ac38249 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5757cd208ac38242 expref: 20 pid: 22766 timeout: 871 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841337.547283:0:22788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fb87480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22788:1875735413518848:0@lo:104: 00000100:00100000:3.0:1788841337.547344:0:22788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:2.0:1788841337.550794:0:24273:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788841337.550804:0:24273:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788841337.550857:0:24273:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788841337.550901:0:24273:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.107@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788841337.550923:0:24273:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788841337.550942:0:24273:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000100:00100000:3.0:1788841337.557498:0:22788:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b7d050240 going to sleep for 11 seconds 00000100:00100000:3.0:1788841337.565301:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413518720 00000100:00100000:3.0:1788841337.565816:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413518720 00000100:00100000:3.0:1788841337.565885:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413518848 00000100:00100000:3.0:1788841337.565888:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413518848 00000100:00100000:3.0:1788841337.565908:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788841337.565917:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7fb85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a456da20-a415-4617-896c-ee7aa5e4c089+4:22788:x1875735413518720:12345-0@lo:104: 00010000:00010000:3.0:1788841337.565935:0:22755:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.107@tcp lock: ffffa04a474aea00/0x5757cd208ac38250 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5757cd208ac38257 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841337.567427:0:22755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788841337.567440:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7fb85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a456da20-a415-4617-896c-ee7aa5e4c089+4:22788:x1875735413518720:12345-0@lo:104: Request processed in 1521us (21749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841337.567464:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788841337.567496:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788841337.567505:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b50686850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a456da20-a415-4617-896c-ee7aa5e4c089+3:22788:x1875735413518848:12345-0@lo:104: 00010000:00010000:3.0:1788841337.567517:0:22755:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.107@tcp lock: ffffa04a474ae000/0x5757cd208ac38242 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5757cd208ac38249 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841337.567580:0:22755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788841337.567585:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b50686850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a456da20-a415-4617-896c-ee7aa5e4c089+3:22788:x1875735413518848:12345-0@lo:104: Request processed in 84us (20242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841337.567592:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788841337.568109:0:22756:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (1/2 left), rc = 0 00010000:00010000:3.0:1788841337.568438:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788841337.568450:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.107@tcp lock: ffffa04a474aea00/0x5757cd208ac38250 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5757cd208ac38257 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841337.568462:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a474aea00 already unused, calling callback (ffffffffc11a4c20) 10000000:00010000:3.0:1788841337.568468:0:22760:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.107@tcp lock: ffffa04a474aea00/0x5757cd208ac38250 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5757cd208ac38257 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841337.568478:0:22760:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.107@tcp lock: ffffa04a474aea00/0x5757cd208ac38250 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5757cd208ac38257 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788841337.568486:0:22760:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.107@tcp lock: ffffa04a474aea00/0x5757cd208ac38250 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5757cd208ac38257 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788841337.568492:0:22760:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788841337.568555:0:22760:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.107@tcp lock: ffffa04a474aea00/0x5757cd208ac38250 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5757cd208ac38257 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841337.568562:0:22760:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788841337.568596:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.107@tcp lock: ffffa04a474aea00/0x5757cd208ac38250 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5757cd208ac38257 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841337.568605:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.107@tcp lock: ffffa04a474aea00/0x5757cd208ac38250 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5757cd208ac38257 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841337.568620:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788841337.568623:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.107@tcp lock: ffffa04a474ae000/0x5757cd208ac38242 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5757cd208ac38249 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841337.568629:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a474ae000 already unused, calling callback (ffffffffc11a4c20) 10000000:00010000:3.0:1788841337.568632:0:22760:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.107@tcp lock: ffffa04a474ae000/0x5757cd208ac38242 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5757cd208ac38249 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841337.568638:0:22760:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.107@tcp lock: ffffa04a474ae000/0x5757cd208ac38242 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5757cd208ac38249 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788841337.568644:0:22760:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.107@tcp lock: ffffa04a474ae000/0x5757cd208ac38242 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5757cd208ac38249 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841337.571011:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fb85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a456da20-a415-4617-896c-ee7aa5e4c089:3651:1875735413518976:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788841337.571097:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788841337.571172:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788841337.571208:0:22788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fb86d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22788:1875735413518720:0@lo:104: 00000100:00100000:0.0:1788841337.571218:0:22788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fb87480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22788:1875735413518848:0@lo:104: 00010000:00010000:0.0:1788841337.571244:0:22788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa04b7a723c00/0x5757cd208ac382ff lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:2.0:1788841337.574938:0:24273:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000100:00100000:0.0:1788841337.575381:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413518976 00000100:00100000:0.0:1788841337.575392:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413518976 00010000:00010000:0.0:1788841337.575432:0:22759:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa04b48dc7c00/0x5757cd208ac38257 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5757cd208ac38250 expref: 21 pid: 22767 timeout: 871 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841337.575479:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788841337.575488:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7c02a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a456da20-a415-4617-896c-ee7aa5e4c089+21:3651:x1875735413518976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788841337.575504:0:22759:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788841337.575510:0:22759:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa04b48dc7c00/0x5757cd208ac38257 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5757cd208ac38250 expref: 21 pid: 22767 timeout: 871 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841337.575523:0:22759:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa04b48dc7c00/0x5757cd208ac38257 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5757cd208ac38250 expref: 21 pid: 22767 timeout: 871 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841337.575542:0:22759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa04b48dc7c00/0x5757cd208ac38257 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5757cd208ac38250 expref: 21 pid: 22767 timeout: 871 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841337.575557:0:22759:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788841337.575636:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7c02a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a456da20-a415-4617-896c-ee7aa5e4c089+20:3651:x1875735413518976:12345-0@lo:103:ldlm_bl.0 Request processed in 148us (4539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841337.575650:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788841337.575698:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fb85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a456da20-a415-4617-896c-ee7aa5e4c089:3651:1875735413518976:0@lo:103:ldlm_bl.0 00000020:00000004:2.0:1788841337.576397:0:24273:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:3.0:1788841337.576625:0:22760:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788841337.577286:0:22760:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.107@tcp lock: ffffa04a474ae000/0x5757cd208ac38242 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5757cd208ac38249 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841337.577298:0:22760:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788841337.577609:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.107@tcp lock: ffffa04a474ae000/0x5757cd208ac38242 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5757cd208ac38249 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841337.577619:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.107@tcp lock: ffffa04a474ae000/0x5757cd208ac38242 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5757cd208ac38249 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841337.577677:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fb85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a456da20-a415-4617-896c-ee7aa5e4c089:3652:1875735413519104:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788841337.577756:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841337.577823:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413519104 00000100:00100000:3.0:1788841337.577829:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413519104 00010000:00010000:3.0:1788841337.577883:0:22758:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa04b48dc6400/0x5757cd208ac38249 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5757cd208ac38242 expref: 20 pid: 22766 timeout: 871 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841337.577911:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788841337.577919:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7cb41450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a456da20-a415-4617-896c-ee7aa5e4c089+20:3652:x1875735413519104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788841337.577932:0:22758:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788841337.577937:0:22758:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa04b48dc6400/0x5757cd208ac38249 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5757cd208ac38242 expref: 20 pid: 22766 timeout: 871 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841337.577949:0:22758:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa04b48dc6400/0x5757cd208ac38249 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5757cd208ac38242 expref: 20 pid: 22766 timeout: 871 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841337.577965:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa04b48dc6400/0x5757cd208ac38249 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5757cd208ac38242 expref: 20 pid: 22766 timeout: 871 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841337.577980:0:22758:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa04b7a723c00/0x5757cd208ac382ff lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841337.577988:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa04b7a723c00/0x5757cd208ac382ff lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788841337.578005:0:22758:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.033455547s 00010000:00010000:3.0:1788841337.578010:0:22758:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa04b7a723c00/0x5757cd208ac382ff lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841337.578026:0:22758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa04b7a723c00/0x5757cd208ac382ff lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841337.578033:0:22758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa04b7a723c00/0x5757cd208ac382ff lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841337.578038:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa04b7a723c00/0x5757cd208ac382ff lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841337.578044:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b7a723c00 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:3.0:1788841337.578048:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa04b7a723c00/0x5757cd208ac382ff lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841337.578056:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa04b7a723c00/0x5757cd208ac382ff lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841337.578070:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa04b7a723c00/0x5757cd208ac382ff lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841337.578092:0:22758:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788841337.578128:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7cb41450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a456da20-a415-4617-896c-ee7aa5e4c089+19:3652:x1875735413519104:12345-0@lo:103:ldlm_bl.0 Request processed in 209us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841337.578136:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788841337.578225:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fb85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a456da20-a415-4617-896c-ee7aa5e4c089:3652:1875735413519104:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788841337.578256:0:22788:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa04b7a723c00/0x5757cd208ac382ff lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841337.578264:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa04b7a723c00/0x5757cd208ac382ff lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841337.578280:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa04b7a723c00/0x5757cd208ac382ff lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841337.578297:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841337.578299:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841337.578301:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841338.190097:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788841338.470435:0:24352:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788841338.470660:0:24352:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:2.0:1788841338.509539:0:22808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1788841338.893391:0:22769:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788841338.893400:0:22769:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa04b521ab000 from 13 10000000:01000000:0.0:1788841338.893407:0:22769:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788841338.893470:0:22769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04a474af800/0x5757cd208ac38306 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841338.893484:0:22769:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.107@tcp lock: ffffa04a474af800/0x5757cd208ac38306 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841338.893498:0:22769:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.107@tcp lock: ffffa04a474af800/0x5757cd208ac38306 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841338.893531:0:22769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c029500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413519232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788841338.893682:0:22769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841338.893796:0:22769:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b67752000 going to sleep for 11 seconds 00000100:00100000:3.0:1788841338.898109:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413519232 00000100:00100000:3.0:1788841338.898199:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413519232 00000100:00100000:3.0:1788841338.898343:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788841338.898358:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a46968050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+19:22769:x1875735413519232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788841338.898380:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788841338.898401:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa04b7a723c00/0x5757cd208ac3830d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5757cd208ac38306 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841338.898431:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa04b7a723c00/0x5757cd208ac3830d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5757cd208ac38306 expref: 20 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841338.898443:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa04b7a723c00/0x5757cd208ac3830d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5757cd208ac38306 expref: 20 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841338.898452:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04b7a723c00, rc 0) 00000100:00100000:3.0:1788841338.898538:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a46968050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+20:22769:x1875735413519232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (4855us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841338.898545:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788841338.898635:0:22769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c029500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413519232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788841338.898656:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.107@tcp lock: ffffa04a474af800/0x5757cd208ac38306 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac3830d expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841338.898666:0:22769:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.107@tcp lock: ffffa04a474af800/0x5757cd208ac38306 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5757cd208ac3830d expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841338.898756:0:22769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c029500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413519360:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788841338.898803:0:22769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841338.908606:0:22769:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b67752000 going to sleep for 11 seconds 00000100:00100000:1.0:1788841338.909546:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413519360 00000100:00100000:1.0:1788841338.909559:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413519360 00000100:00100000:1.0:1788841338.909623:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788841338.909632:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a46968450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+20:22769:x1875735413519360:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788841338.909657:0:22764:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788841338.909678:0:22764:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788841338.909682:0:22764:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1788841338.910157:0:22769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c029500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413519360:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788841338.910232:0:22769:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.107@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788841338.910244:0:22769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04a474af800/0x5757cd208ac38306 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac3830d expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841338.910255:0:22769:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.107@tcp lock: ffffa04a474af800/0x5757cd208ac38306 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac3830d expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788841338.910265:0:22769:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788841338.910267:0:22769:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa04a45f80000 from 13 10000000:01000000:0.0:1788841338.910270:0:22769:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788841338.910300:0:22769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04a474aee00/0x5757cd208ac38314 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841338.910307:0:22769:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.107@tcp lock: ffffa04a474aee00/0x5757cd208ac38314 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841338.910316:0:22769:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.107@tcp lock: ffffa04a474aee00/0x5757cd208ac38314 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841338.910336:0:22769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c029500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413519488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788841338.910375:0:22769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841338.910397:0:22769:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b67752000 going to sleep for 11 seconds 00000100:00100000:1.0:1788841338.910495:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a46968450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+20:22769:x1875735413519360:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 323us (11151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841338.910506:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788841338.910534:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413519488 00000100:00100000:1.0:1788841338.910539:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413519488 00000100:00100000:1.0:1788841338.910559:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788841338.910681:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a4696a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+20:22769:x1875735413519488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788841338.910693:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788841338.910706:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa04b48dc6000/0x5757cd208ac3831b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5757cd208ac38314 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841338.910796:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa04b48dc6000/0x5757cd208ac3831b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5757cd208ac38314 expref: 21 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841338.910819:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa04b48dc6000/0x5757cd208ac3831b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5757cd208ac38314 expref: 21 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841338.910829:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04b48dc6000, rc 0) 00000100:00100000:1.0:1788841338.910950:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a4696a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+21:22769:x1875735413519488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 384us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841338.911297:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788841338.912698:0:22769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c029500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413519488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788841338.913310:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.107@tcp lock: ffffa04a474aee00/0x5757cd208ac38314 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac3831b expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841338.913341:0:22769:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.107@tcp lock: ffffa04a474aee00/0x5757cd208ac38314 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5757cd208ac3831b expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841338.913412:0:22769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c029500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413519616:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788841338.913482:0:22769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841338.913524:0:22769:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b67752000 going to sleep for 11 seconds 00000100:00100000:3.0:1788841338.914282:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413519616 00000100:00100000:3.0:1788841338.914293:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413519616 00000100:00100000:3.0:1788841338.914351:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788841338.914371:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a4696b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+21:22769:x1875735413519616:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788841338.914395:0:22766:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788841338.914412:0:22766:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788841338.914415:0:22766:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:3.0:1788841338.914522:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a4696b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+21:22769:x1875735413519616:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 152us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841338.914529:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788841338.914578:0:22769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c029500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413519616:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788841338.914642:0:22769:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.107@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788841338.914650:0:22769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04a474aee00/0x5757cd208ac38314 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac3831b expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841338.914659:0:22769:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.107@tcp lock: ffffa04a474aee00/0x5757cd208ac38314 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac3831b expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841339.218615:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841340.241062:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841341.263097:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788841341.453288:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fb85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875735413519872:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788841341.453364:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841341.453414:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788841341.453420:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b491d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875735413519744:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788841341.453443:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841341.453545:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413519872 00000100:00100000:2.0:1788841341.453554:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413519872 00000100:00100000:3.0:1788841341.453585:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413519744 00000100:00100000:3.0:1788841341.453593:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413519744 00000100:00100000:2.0:1788841341.453605:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788841341.453618:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6d9e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875735413519872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788841341.453656:0:22778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788841341.453711:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6d9e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875735413519872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841341.453718:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788841341.453751:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788841341.453757:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6d9e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875735413519744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788841341.453775:0:22778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788841341.453803:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6d9e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875735413519744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 46us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841341.453809:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788841341.453913:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b491d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875735413519744:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788841341.453928:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fb85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875735413519872:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788841342.285982:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788841342.989184:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788841342.989225:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788841342.989228:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788841342.989232:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788841342.989263:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788841342.989266:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788841342.989269:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788841342.989284:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788841342.989338:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fb85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875735413520128:0@lo:400:kworker.0 00000100:00100000:3.0:1788841342.989451:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841342.989502:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fb84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1875735413520640:0@lo:400:kworker.0 00000100:00100000:3.0:1788841342.989534:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841342.989563:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788841342.989569:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fb86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a456da20-a415-4617-896c-ee7aa5e4c089:3652:1875735413520000:0@lo:400:kworker.0 00000100:00100000:3.0:1788841342.989603:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841342.989626:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fb87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875735413520512:0@lo:400:kworker.0 00000100:00100000:3.0:1788841342.989665:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841342.989691:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fb84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875735413520384:0@lo:400:kworker.0 00000100:00100000:3.0:1788841342.989716:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841342.989735:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788841342.989740:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fb85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875735413520256:0@lo:400:kworker.0 00000100:00100000:3.0:1788841342.989761:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841342.989778:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fb87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1875735413520768:0@lo:400:kworker.0 00000100:00100000:3.0:1788841342.989802:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841342.989825:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413520128 00000100:00100000:3.0:1788841342.989864:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413520128 00000100:00100000:3.0:1788841342.989907:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413520384 00000100:00100000:3.0:1788841342.989910:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413520384 00000100:00100000:3.0:1788841342.989928:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788841342.989937:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7fb84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875735413520128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841342.990014:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7fb84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875735413520128:12345-0@lo:400:kworker.0 Request processed in 77us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841342.990032:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788841342.990052:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788841342.990059:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7fb84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875735413520384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841342.990095:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7fb84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875735413520384:12345-0@lo:400:kworker.0 Request processed in 37us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841342.990102:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788841342.990123:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413520640 00000100:00100000:3.0:1788841342.990127:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413520640 00000100:00100000:3.0:1788841342.990176:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413520512 00000100:00100000:3.0:1788841342.990180:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413520512 00000100:00100000:3.0:1788841342.990191:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413520256 00000100:00100000:3.0:1788841342.990194:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413520256 00000100:00100000:3.0:1788841342.990203:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413520768 00000100:00100000:3.0:1788841342.990206:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413520768 00000100:00100000:3.0:1788841342.990223:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788841342.990230:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7fb86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875735413520640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841342.990263:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7fb86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875735413520640:12345-0@lo:400:kworker.0 Request processed in 34us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841342.990270:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788841342.990282:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788841342.990288:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7fb84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875735413520512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841342.990314:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7fb84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875735413520512:12345-0@lo:400:kworker.0 Request processed in 26us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841342.990320:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788841342.990331:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788841342.990337:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7fb85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875735413520256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841342.990373:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7fb85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875735413520256:12345-0@lo:400:kworker.0 Request processed in 36us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841342.990379:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788841342.990390:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788841342.990397:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7fb87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875735413520768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841342.990424:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7fb87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875735413520768:12345-0@lo:400:kworker.0 Request processed in 29us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841342.990430:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788841342.990449:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413520000 00000100:00100000:3.0:1788841342.990453:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413520000 00000100:00100000:3.0:1788841342.990480:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788841342.990486:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a46969450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+21:3652:x1875735413520000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841342.990517:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a46969450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+21:3652:x1875735413520000:12345-0@lo:400:kworker.0 Request processed in 31us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841342.990524:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:3.0:1788841342.990578:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa04b7fb85180 x1875735413520256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841342.990592:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fb85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875735413520256:0@lo:400:kworker.0 00010000:00080000:3.0:1788841342.990602:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa04b7fb87b80 x1875735413520768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841342.990611:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fb87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1875735413520768:0@lo:400:kworker.0 00000100:00100000:3.0:1788841342.990622:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fb84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875735413520384:0@lo:400:kworker.0 00000100:00100000:3.0:1788841342.990651:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fb86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a456da20-a415-4617-896c-ee7aa5e4c089:3652:1875735413520000:0@lo:400:kworker.0 00010000:00080000:3.0:1788841342.990673:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa04b7fb87800 x1875735413520512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841342.990681:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fb87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875735413520512:0@lo:400:kworker.0 00000100:00100000:3.0:1788841342.990692:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fb85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875735413520128:0@lo:400:kworker.0 00010000:00080000:3.0:1788841342.990701:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa04b7fb84a80 x1875735413520640/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841342.990707:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fb84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1875735413520640:0@lo:400:kworker.0 00000100:00080000:3.0:1788841342.991037:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788841342.991043:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1788841343.245485:0:23525:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788841343.312617:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788841344.311142:0:24643:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg407-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788841344.333037:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788841345.328434:0:24695:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788841345.328656:0:24695:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788841345.358868:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788841345.748043:0:3648:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788841330/real 1788841330] req@ffffa04b6d9e0000 x1875735413512576/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788841345 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788841345.748083:0:3648:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa04b6d9e0000 x1875735413512576/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788841345 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788841345.748094:0:3648:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788841330/real 1788841330] req@ffffa04b6d9e2a00 x1875735413512704/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788841345 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788841345.748107:0:3648:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa04b6d9e2a00 x1875735413512704/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788841345 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788841345.748142:0:3648:0:(import.c:65:import_set_state_nolock()) ffffa04b7cf0c800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788841345.748166:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788841345.748170:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6d9e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875735413512576:0@lo:8:kworker.0 00000100:00080000:1.0:1788841345.748175:0:3648:0:(import.c:65:import_set_state_nolock()) ffffa04b7cea3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788841345.748180:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788841345.748183:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6d9e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875735413512704:0@lo:8:kworker.0 00000100:00080000:2.0:1788841345.748324:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788841345.748329:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788841345.748332:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788841345.748335:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788841345.748349:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788841345.748352:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788841345.748355:0:37:0:(import.c:65:import_set_state_nolock()) ffffa04b7cf0c800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788841345.748360:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 764 00000100:00080000:2.0:1788841345.748365:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788841345.748372:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffffa04b7cf0c800 using connection 192.168.204.107@tcp/0@lo 00000100:00100000:2.0:1788841345.748395:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa04b491d3b80 x1875735413521408/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788841345.748418:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788841345.748421:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788841345.748422:0:37:0:(import.c:65:import_set_state_nolock()) ffffa04b7cea3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788841345.748425:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 764 00000100:00080000:2.0:1788841345.748428:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788841345.748438:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffffa04b7cea3800 using connection 192.168.204.107@tcp/0@lo 00000100:00100000:2.0:1788841345.748451:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa04b491d2d80 x1875735413521536/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788841345.748489:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b491d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875735413521024:0@lo:400:kworker.0 00000100:00100000:2.0:1788841345.748549:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841345.748588:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b491d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1875735413521792:0@lo:400:kworker.0 00000100:00100000:2.0:1788841345.748616:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841345.748633:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788841345.748643:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b491d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875735413521152:0@lo:400:kworker.0 00000100:00100000:2.0:1788841345.748667:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841345.748679:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b491d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875735413521920:0@lo:400:kworker.0 00000100:00100000:2.0:1788841345.748698:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841345.748728:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413521792 00000100:00100000:2.0:1788841345.748737:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413521792 00000100:00100000:2.0:1788841345.748782:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413521152 00000100:00100000:2.0:1788841345.748785:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413521152 00000100:00100000:2.0:1788841345.748795:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413521920 00000100:00100000:2.0:1788841345.748798:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413521920 00000100:00100000:2.0:1788841345.748812:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788841345.748820:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b491d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875735413521792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841345.749122:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b491d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875735413521792:12345-0@lo:400:kworker.0 Request processed in 301us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841345.749130:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788841345.749147:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788841345.749153:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47b46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875735413521152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841345.749179:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47b46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875735413521152:12345-0@lo:400:kworker.0 Request processed in 26us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841345.749192:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788841345.749203:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788841345.749208:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47b47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875735413521920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841345.749233:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47b47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875735413521920:12345-0@lo:400:kworker.0 Request processed in 25us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841345.749239:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788841345.749258:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b491d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875735413521408:0@lo:8:kworker.0 00000100:00100000:1.0:1788841345.750018:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b491d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875735413521280:0@lo:400:kworker.0 00000100:00100000:0.0:1788841345.750038:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b491d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a456da20-a415-4617-896c-ee7aa5e4c089:3650:1875735413520896:0@lo:400:kworker.0 00000100:00100000:0.0:1788841345.750083:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841345.750119:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b491d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875735413521664:0@lo:400:kworker.0 00000100:00100000:0.0:1788841345.750146:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841345.750170:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841345.750201:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b491d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875735413521536:0@lo:8:kworker.0 00000100:00100000:1.0:1788841345.750210:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841345.750211:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413520896 00000100:00100000:0.0:1788841345.750220:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413520896 00000100:00100000:2.0:1788841345.750226:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841345.750259:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413521664 00000100:00100000:2.0:1788841345.750263:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413521664 00000100:00100000:0.0:1788841345.750292:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788841345.750293:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788841345.750307:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a4696a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+21:3650:x1875735413520896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841345.750308:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7c029880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875735413521664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841345.750463:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7c029880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875735413521664:12345-0@lo:400:kworker.0 Request processed in 160us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841345.750470:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788841345.750542:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413521024 00000100:00100000:3.0:1788841345.750549:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413521024 00000100:00100000:3.0:1788841345.750580:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413521280 00000100:00100000:3.0:1788841345.750583:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413521280 00000100:00100000:3.0:1788841345.750596:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788841345.750603:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b491d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875735413521024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841345.750647:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b491d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875735413521024:12345-0@lo:400:kworker.0 Request processed in 45us (2098us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841345.750654:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788841345.750665:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788841345.750670:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6d9e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875735413521280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841345.750709:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6d9e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875735413521280:12345-0@lo:400:kworker.0 Request processed in 39us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841345.750714:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1788841345.750734:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788841345.750750:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788841345.750771:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413521408 00000100:00100000:3.0:1788841345.750775:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413521408 00000100:00100000:3.0:1788841345.750791:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413521536 00000100:00100000:3.0:1788841345.750794:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413521536 00000100:00100000:2.0:1788841345.750800:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b491d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875735413521280:0@lo:400:kworker.0 00000100:00100000:3.0:1788841345.750806:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788841345.750812:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47b46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3648:x1875735413521408:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788841345.750864:0:24277:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 779 last 0 00000020:00000080:3.0:1788841345.750896:0:24277:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5757cd208ac38322 00002000:00100000:3.0:1788841345.750912:0:24277:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffffa04a47f1b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113972 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1788841345.750917:0:24277:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1788841345.751127:0:24277:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788841345.751329:0:24277:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00100000:0.0:1788841345.754592:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a4696a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+21:3650:x1875735413520896:12345-0@lo:400:kworker.0 Request processed in 4278us (4496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841345.754608:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:3.0:1788841345.755040:0:24277:0:(import.c:65:import_set_state_nolock()) ffffa04a47f19800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788841345.755132:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47b46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3648:x1875735413521408:12345-0@lo:8:kworker.0 Request processed in 4318us (4963us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841345.755140:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788841345.755162:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788841345.755169:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47b47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3648:x1875735413521536:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788841345.755190:0:24277:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788841345.757608:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b491d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a456da20-a415-4617-896c-ee7aa5e4c089:3650:1875735413520896:0@lo:400:kworker.0 00010000:00080000:1.0:1788841345.757632:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa04b491d0000 x1875735413521664/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788841345.757645:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b491d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875735413521664:0@lo:400:kworker.0 00010000:00080000:0.0:1788841345.758038:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa04b491d0e00 x1875735413521152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841345.758050:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b491d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875735413521152:0@lo:400:kworker.0 00010000:00080000:0.0:1788841345.758081:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa04b491d3480 x1875735413521920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841345.758090:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b491d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875735413521920:0@lo:400:kworker.0 00000100:00100000:0.0:1788841345.758103:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b491d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875735413521024:0@lo:400:kworker.0 00010000:00080000:0.0:1788841345.758112:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa04b491d2a00 x1875735413521792/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841345.758120:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b491d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1875735413521792:0@lo:400:kworker.0 00010000:00080000:2.0:1788841345.781955:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa04b491d3b80 x1875735413521408/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788841365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841345.781969:0:3648:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788841345.781979:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1788841345.783194:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788841345.783206:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788841345.783226:0:3648:0:(import.c:65:import_set_state_nolock()) ffffa04b7cf0c800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788841345.783256:0:3648:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788841345.783267:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b491d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875735413521408:0@lo:8:kworker.0 00000004:00080000:0.0:1788841345.783425:0:23515:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000004:00080000:1.0:1788841345.783451:0:23514:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1788841345.783452:0:23515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c02aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23515:1875735413522176:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1788841345.783531:0:23515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788841345.783557:0:23514:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 779977723021ns, next at 0ns, rc = 0 00000100:00100000:0.0:1788841345.783564:0:23515:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b473da000 going to sleep for 11 seconds 00080000:00080000:1.0:1788841345.783566:0:23514:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1788841345.783582:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c028380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875735413522048:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788841345.783610:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841345.783660:0:24279:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788841345.783667:0:24279:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788841345.783739:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413522048 00000100:00100000:1.0:1788841345.783748:0:24280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413522048 00000100:00100000:1.0:1788841345.783820:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788841345.783857:0:24280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7c029f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1875735413522048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788841345.783887:0:24280:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788841345.783945:0:24280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7c029f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1875735413522048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 116us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841345.783953:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788841345.783980:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788841345.784647:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa04b7c028380 x1875735413522048/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841361 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841345.784668:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c028380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875735413522048:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788841345.788469:0:24279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413522176 00000100:00100000:0.0:1788841345.788483:0:24279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413522176 00000100:00100000:1.0:1788841345.788702:0:24716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788841345.788716:0:24716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7c02a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23515:x1875735413522176:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1788841345.792202:0:23506:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:0.0:1788841345.792527:0:24716:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1788841345.792534:0:24716:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:0.0:1788841345.792666:0:24716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7c02a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23515:x1875735413522176:12345-0@lo:7:osp-pre-0-1.0 Request processed in 3948us (9130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841345.792685:0:24716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788841345.794427:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47b47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3648:x1875735413521536:12345-0@lo:8:kworker.0 Request processed in 39250us (44192us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788841345.794439:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788841345.794643:0:3648:0:(import.c:65:import_set_state_nolock()) ffffa04b7cea3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788841345.794648:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788841345.794651:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b491d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875735413521536:0@lo:8:kworker.0 00010000:00080000:2.0:1788841345.796696:0:23515:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa04b7c02aa00 x1875735413522176/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788841361 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841345.796719:0:23515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c02aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23515:1875735413522176:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1788841345.796733:0:23515:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:2.0:1788841345.796779:0:23515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47b44700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23515:1875735413522304:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1788841345.797000:0:23515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841345.797145:0:24279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413522304 00000100:00100000:1.0:1788841345.797153:0:24279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413522304 00000100:00100000:1.0:1788841345.797203:0:24279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788841345.797213:0:24279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47b45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23515:x1875735413522304:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1788841345.797240:0:24279:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1788841345.798396:0:24279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47b45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23515:x1875735413522304:12345-0@lo:5:osp-pre-0-1.0 Request processed in 1180us (1559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841345.798407:0:24279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788841345.798508:0:23515:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b7f82b300 going to sleep for 11 seconds 00010000:00080000:2.0:1788841345.798532:0:23515:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa04a47b44700 x1875735413522304/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788841361 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841345.798545:0:23515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47b44700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23515:1875735413522304:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1788841345.798557:0:23515:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:2.0:1788841345.798593:0:23515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47b44700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23515:1875735413522432:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1788841345.798628:0:23515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841345.798688:0:23515:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b7f82b300 going to sleep for 11 seconds 00000100:00100000:0.0:1788841345.798721:0:24716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413522432 00000100:00100000:0.0:1788841345.798727:0:24716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413522432 00000100:00100000:0.0:1788841345.798950:0:24716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788841345.798961:0:24716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47b47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23515:x1875735413522432:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788841345.799011:0:24716:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000001:00080000:1.0:1788841345.822479:0:24274:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:1.0:1788841345.822496:0:24274:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1788841345.822716:0:24716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47b47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:23515:x1875735413522432:12345-0@lo:5:osp-pre-0-1.0 Request processed in 23750us (24080us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1788841345.822732:0:24716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788841345.823259:0:23515:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa04a47b44700 x1875735413522432/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788841361 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841345.823273:0:23515:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1788841345.823279:0:23515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47b44700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23515:1875735413522432:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1788841345.823294:0:23515:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:0.0:1788841345.823350:0:23515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c028380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23515:1875735413522560:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788841345.823443:0:23515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841345.823475:0:23515:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b473da0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788841345.826879:0:22784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413522560 00000100:00100000:1.0:1788841345.826893:0:22784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413522560 00000100:00100000:1.0:1788841345.826959:0:22784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788841345.826969:0:22784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7c02aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23515:x1875735413522560:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1788841345.827101:0:22784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7c02aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23515:x1875735413522560:12345-0@lo:900:osp-pre-0-1.0 Request processed in 133us (3657us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841345.827109:0:22784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788841345.827185:0:23515:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa04b7c028380 x1875735413522560/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788841361 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841345.827202:0:23515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c028380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23515:1875735413522560:0@lo:900:osp-pre-0-1.0 00000020:00000004:1.0:1788841346.218829:0:24746:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788841346.219152:0:24746:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788841346.383866:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788841346.574407:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788841346.574431:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47b44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875735413522688:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788841346.574504:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841346.574689:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413522688 00000100:00100000:2.0:1788841346.574698:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413522688 00000100:00100000:2.0:1788841346.575081:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788841346.575095:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7c029500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875735413522688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788841346.575154:0:22777:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788841346.575209:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7c029500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875735413522688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 117us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841346.575216:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788841346.575274:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47b44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875735413522688:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788841346.580353:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fb84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875735413522816:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788841346.580450:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841346.580595:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413522816 00000100:00100000:3.0:1788841346.580604:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413522816 00000100:00100000:3.0:1788841346.580664:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788841346.580674:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7c02a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875735413522816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788841346.580715:0:22777:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788841346.580777:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7c02a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875735413522816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841346.580785:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788841346.580882:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fb84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875735413522816:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788841347.405269:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841348.430257:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788841348.754361:0:22808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788841349.453297:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841350.488171:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788841351.181037:0:22177:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788841351.181045:0:22177:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788841351.181048:0:22177:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788841351.181051:0:22177:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788841351.181075:0:22177:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788841351.181079:0:22177:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788841351.181083:0:22177:0:(import.c:65:import_set_state_nolock()) ffffa04b7cea3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788841351.181102:0:22177:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 779 00000100:00080000:0.0:1788841351.181108:0:22177:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788841351.181115:0:22177:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffffa04b7cea3800 using connection 192.168.204.107@tcp/0@lo 00000100:00100000:0.0:1788841351.181138:0:22177:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa04b7fa06a00 x1875735413523584/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788841351.181209:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c02b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a456da20-a415-4617-896c-ee7aa5e4c089:3652:1875735413522944:0@lo:400:kworker.0 00000100:00100000:1.0:1788841351.181248:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fa05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875735413523328:0@lo:400:kworker.0 00000100:00100000:3.0:1788841351.181408:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c02b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875735413523072:0@lo:400:kworker.0 00000100:00100000:0.0:1788841351.181707:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7c028380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875735413523200:0@lo:400:kworker.0 00000100:00100000:1.0:1788841351.182895:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841351.182995:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fa04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875735413523968:0@lo:400:kworker.0 00000100:00100000:1.0:1788841351.183030:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841351.183067:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788841351.183074:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fb84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875735413524096:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788841351.183223:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841351.183268:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fa06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875735413523584:0@lo:8:kworker.0 00000100:00100000:1.0:1788841351.183296:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841351.183344:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413523328 00000100:00100000:1.0:1788841351.183353:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413523328 00000100:00100000:1.0:1788841351.183793:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788841351.183806:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6d9e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875735413523328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841351.183909:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6d9e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875735413523328:12345-0@lo:400:kworker.0 Request processed in 106us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841351.183917:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788841351.183945:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413523968 00000100:00100000:1.0:1788841351.183949:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413523968 00000100:00100000:1.0:1788841351.184136:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788841351.184143:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6d9e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875735413523968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841351.184174:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6d9e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875735413523968:12345-0@lo:400:kworker.0 Request processed in 32us (1144us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841351.184179:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788841351.184197:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413524096 00000100:00100000:1.0:1788841351.184200:0:24280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413524096 00000100:00100000:1.0:1788841351.184225:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788841351.184230:0:24280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6d9e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875735413524096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788841351.184255:0:24280:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788841351.184283:0:24280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6d9e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875735413524096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841351.184311:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788841351.184329:0:24279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413523584 00000100:00100000:1.0:1788841351.184333:0:24279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413523584 00000100:00100000:1.0:1788841351.184349:0:24279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788841351.184354:0:24279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6d9e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3648:x1875735413523584:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788841351.184374:0:24279:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788841351.184420:0:24279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6d9e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3648:x1875735413523584:12345-0@lo:8:kworker.0 Request processed in 65us (1123us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788841351.184426:0:24279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788841351.184443:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788841351.184448:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788841351.184757:0:3648:0:(import.c:65:import_set_state_nolock()) ffffa04b7cea3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788841351.184763:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788841351.184768:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fa06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875735413523584:0@lo:8:kworker.0 00010000:00080000:1.0:1788841351.184804:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa04b7fb84a80 x1875735413524096/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841367 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788841351.184850:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fb84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875735413524096:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788841351.184866:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fa05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875735413523328:0@lo:400:kworker.0 00010000:00080000:1.0:1788841351.184878:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa04b7fa04700 x1875735413523968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788841351.184886:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fa04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875735413523968:0@lo:400:kworker.0 00000100:00100000:2.0:1788841351.189231:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841351.189322:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413522944 00000100:00100000:1.0:1788841351.189333:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413522944 00000100:00100000:1.0:1788841351.189397:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788841351.189430:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a4696ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+21:3652:x1875735413522944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841351.189502:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a4696ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+21:3652:x1875735413522944:12345-0@lo:400:kworker.0 Request processed in 64us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841351.189509:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788841351.189738:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841351.189880:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fa05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875735413523712:0@lo:400:kworker.0 00000100:00100000:3.0:1788841351.189979:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841351.190024:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413523712 00000100:00100000:3.0:1788841351.190029:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413523712 00000100:00100000:3.0:1788841351.190063:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788841351.190071:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7fb87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875735413523712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841351.190124:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7fb87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875735413523712:12345-0@lo:400:kworker.0 Request processed in 53us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841351.190131:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1788841351.190172:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa04b7fa05180 x1875735413523712/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841351.190187:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fa05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875735413523712:0@lo:400:kworker.0 00000100:00100000:0.0:1788841351.191187:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841351.191229:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fa04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1875735413523840:0@lo:400:kworker.0 00000100:00100000:0.0:1788841351.191252:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841351.191294:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413523200 00000100:00100000:0.0:1788841351.191662:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413523200 00000100:00100000:0.0:1788841351.191697:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413523840 00000100:00100000:0.0:1788841351.191701:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413523840 00000100:00100000:0.0:1788841351.191732:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788841351.191740:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7fa07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875735413523200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841351.191801:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7fa07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875735413523200:12345-0@lo:400:kworker.0 Request processed in 61us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841351.191853:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788841351.191872:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788841351.191878:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7fa07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875735413523840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841351.191908:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7fa07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875735413523840:12345-0@lo:400:kworker.0 Request processed in 30us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841351.191914:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1788841351.191948:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa04b7c028380 x1875735413523200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841351.191982:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c028380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875735413523200:0@lo:400:kworker.0 00010000:00080000:0.0:1788841351.191996:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa04b7fa04a80 x1875735413523840/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841351.192006:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fa04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1875735413523840:0@lo:400:kworker.0 00000100:00080000:0.0:1788841351.192058:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788841351.193254:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413523072 00000100:00100000:1.0:1788841351.193264:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413523072 00000100:00100000:2.0:1788841351.193737:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c02b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a456da20-a415-4617-896c-ee7aa5e4c089:3652:1875735413522944:0@lo:400:kworker.0 00000100:00100000:2.0:1788841351.193751:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fa06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875735413523456:0@lo:400:kworker.0 00000100:00100000:2.0:1788841351.193807:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841351.193851:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788841351.193863:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7fb85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875735413523072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841351.193922:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7fb85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875735413523072:12345-0@lo:400:kworker.0 Request processed in 62us (4535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841351.193929:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788841351.194052:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413523456 00000100:00100000:3.0:1788841351.194059:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413523456 00000100:00100000:3.0:1788841351.194131:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788841351.194139:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47b44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875735413523456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841351.194185:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47b44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875735413523456:12345-0@lo:400:kworker.0 Request processed in 47us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841351.194193:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788841351.194210:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7c02b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875735413523072:0@lo:400:kworker.0 00010000:00080000:2.0:1788841351.194395:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa04b7fa06d80 x1875735413523456/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788841367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841351.194407:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fa06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875735413523456:0@lo:400:kworker.0 00010000:00010000:1.0:1788841351.501377:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788841351.698110:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788841351.698135:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fa04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875735413524224:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788841351.698219:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841351.699242:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788841351.699266:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6d9e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875735413524352:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788841351.699319:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841351.701376:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413524224 00000100:00100000:0.0:1788841351.701407:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413524224 00000100:00100000:0.0:1788841351.701465:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413524352 00000100:00100000:0.0:1788841351.701469:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413524352 00000100:00100000:0.0:1788841351.701486:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788841351.701495:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7fa04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875735413524224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788841351.701541:0:22778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788841351.701659:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7fa04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875735413524224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 163us (3439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841351.701667:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788841351.701688:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788841351.701695:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6d9e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875735413524352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788841351.701714:0:22778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788841351.701762:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6d9e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875735413524352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (2442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841351.701769:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788841351.701897:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fa04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875735413524224:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788841351.701993:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6d9e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875735413524352:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788841352.205728:0:3648:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788841331/real 1788841331] req@ffffa04b6e05ca80 x1875735413514112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788841351 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841352.205766:0:3648:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa04b6e05ca80 x1875735413514112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788841351 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841352.205777:0:3648:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788841331/real 1788841331] req@ffffa04b6e05e680 x1875735413514240/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788841351 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841352.205788:0:3648:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa04b6e05e680 x1875735413514240/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788841351 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788841352.205820:0:3648:0:(import.c:65:import_set_state_nolock()) ffffa04b5210f000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788841352.205892:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788841352.205898:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875735413514112:0@lo:8:kworker.0 00000100:00080000:2.0:1788841352.205908:0:3648:0:(import.c:65:import_set_state_nolock()) ffffa04a47d02000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788841352.205916:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788841352.205920:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875735413514240:0@lo:8:kworker.0 00000100:00080000:1.0:1788841352.206269:0:22177:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788841352.206275:0:22177:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788841352.206278:0:22177:0:(import.c:65:import_set_state_nolock()) ffffa04b5210f000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788841352.206285:0:22177:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 765 00000100:00080000:1.0:1788841352.206290:0:22177:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788841352.206299:0:22177:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffffa04b5210f000 using connection 192.168.204.107@tcp/0@lo 00000100:00100000:1.0:1788841352.206340:0:22177:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa04b581a4380 x1875735413524736/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788841352.206354:0:22177:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788841352.206357:0:22177:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788841352.206359:0:22177:0:(import.c:65:import_set_state_nolock()) ffffa04a47d02000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788841352.206364:0:22177:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 765 00000100:00080000:1.0:1788841352.206367:0:22177:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788841352.206371:0:22177:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa04a47d02000 using connection 192.168.204.107@tcp/0@lo 00000100:00100000:1.0:1788841352.206393:0:22177:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa04b581a6d80 x1875735413524864/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788841352.206459:0:22177:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788841352.206463:0:22177:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788841352.206465:0:22177:0:(import.c:65:import_set_state_nolock()) ffffa04b7cea3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788841352.206469:0:22177:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 785 00000100:00080000:1.0:1788841352.206472:0:22177:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788841352.206476:0:22177:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffffa04b7cea3800 using connection 192.168.204.107@tcp/0@lo 00000100:00100000:1.0:1788841352.206876:0:22177:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa04b581a5500 x1875735413525376/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788841352.206938:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b581a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875735413525120:0@lo:400:kworker.0 00000100:00100000:1.0:1788841352.207008:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841352.207043:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b581a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1875735413525760:0@lo:400:kworker.0 00000100:00100000:1.0:1788841352.207067:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841352.207091:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788841352.207097:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b581a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875735413524992:0@lo:400:kworker.0 00000100:00100000:1.0:1788841352.207119:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841352.207136:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b581a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1875735413525632:0@lo:400:kworker.0 00000100:00100000:1.0:1788841352.207163:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841352.207198:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413525760 00000100:00100000:1.0:1788841352.207205:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413525760 00000100:00100000:3.0:1788841352.207268:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413524992 00000100:00100000:3.0:1788841352.207274:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413524992 00000100:00100000:0.0:1788841352.207411:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413525120 00000100:00100000:0.0:1788841352.207416:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413525120 00000100:00100000:0.0:1788841352.207452:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788841352.207461:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b581a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875735413525120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841352.207523:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b581a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875735413525120:12345-0@lo:400:kworker.0 Request processed in 63us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841352.207530:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788841352.207555:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413525632 00000100:00100000:0.0:1788841352.207559:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413525632 00000100:00100000:2.0:1788841352.207651:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6d9e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a456da20-a415-4617-896c-ee7aa5e4c089:3651:1875735413524480:0@lo:400:kworker.0 00000100:00100000:2.0:1788841352.207871:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841352.207909:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b581a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875735413525248:0@lo:400:kworker.0 00000100:00100000:2.0:1788841352.208059:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841352.208088:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788841352.208094:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788841352.208098:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6d9e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875735413524608:0@lo:400:kworker.0 00000100:00100000:3.0:1788841352.208109:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b581a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875735413525760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841352.208128:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841352.208151:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b581a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875735413525504:0@lo:400:kworker.0 00000100:00100000:3.0:1788841352.208165:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b581a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875735413525760:12345-0@lo:400:kworker.0 Request processed in 61us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841352.208174:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788841352.208180:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841352.208192:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413525504 00000100:00100000:3.0:1788841352.208198:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413525504 00000100:00100000:2.0:1788841352.208211:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413524480 00000100:00100000:2.0:1788841352.208217:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413524480 00000100:00100000:3.0:1788841352.208223:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788841352.208270:0:22774:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788841352.208279:0:22774:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788841352.208296:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413524608 00000100:00100000:0.0:1788841352.208300:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413524608 00000100:00100000:0.0:1788841352.208332:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788841352.208337:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b491d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875735413524608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841352.208377:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b491d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875735413524608:12345-0@lo:400:kworker.0 Request processed in 39us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841352.208382:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788841352.208454:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b581a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875735413524992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841352.208487:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b581a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875735413524992:12345-0@lo:400:kworker.0 Request processed in 256us (1367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841352.208493:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788841352.208499:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b491d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875735413525504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841352.208503:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788841352.208514:0:22772:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788841352.208521:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788841352.208527:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b581a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875735413525632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841352.208528:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b491d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875735413525504:12345-0@lo:400:kworker.0 Request processed in 30us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841352.208533:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788841352.208553:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b581a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875735413525632:12345-0@lo:400:kworker.0 Request processed in 27us (1390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841352.208559:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1788841352.208988:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa04b581a7800 x1875735413524992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841352.209013:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b581a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875735413524992:0@lo:400:kworker.0 00010000:00080000:0.0:1788841352.209152:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa04b581a5180 x1875735413525632/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841352.209161:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b581a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1875735413525632:0@lo:400:kworker.0 00000100:00100000:0.0:1788841352.209174:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b581a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875735413525120:0@lo:400:kworker.0 00010000:00080000:0.0:1788841352.209185:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa04b581a4e00 x1875735413525760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841352.209194:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b581a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1875735413525760:0@lo:400:kworker.0 00000100:00100000:2.0:1788841352.209953:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788841352.209969:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a4696b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+21:3651:x1875735413524480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841352.210038:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a4696b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+21:3651:x1875735413524480:12345-0@lo:400:kworker.0 Request processed in 75us (2173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841352.210046:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788841352.210085:0:24279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413525248 00000100:00100000:2.0:1788841352.210092:0:24279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413525248 00000100:00100000:2.0:1788841352.211864:0:24279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788841352.211878:0:24279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b491d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875735413525248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841352.211969:0:24279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b491d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875735413525248:12345-0@lo:400:kworker.0 Request processed in 95us (3908us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841352.211977:0:24279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788841352.212024:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b581a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875735413524736:0@lo:8:kworker.0 00000100:00100000:2.0:1788841352.212062:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841352.212097:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b581a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875735413524864:0@lo:8:kworker.0 00000100:00100000:2.0:1788841352.212118:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841352.212135:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b581a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875735413525376:0@lo:8:kworker.0 00000100:00100000:2.0:1788841352.212151:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841352.212182:0:24716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413524736 00000100:00100000:2.0:1788841352.212189:0:24716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413524736 00000100:00100000:2.0:1788841352.212211:0:24716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413524864 00000100:00100000:2.0:1788841352.212215:0:24716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413524864 00000100:00100000:2.0:1788841352.212223:0:24716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413525376 00000100:00100000:2.0:1788841352.212225:0:24716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413525376 00000100:00100000:2.0:1788841352.212235:0:24716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788841352.212239:0:24716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b491d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3648:x1875735413524736:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788841352.212266:0:24716:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 786 last 0 00000020:00000080:2.0:1788841352.212296:0:24716:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5757cd208ac38329 00002000:00100000:2.0:1788841352.212309:0:24716:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffffa04a47bd4800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113972 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788841352.212314:0:24716:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788841352.212317:0:24716:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1788841352.212324:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788841352.212331:0:24278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b491d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3648:x1875735413524864:12345-0@lo:8:kworker.0 00002000:00080000:2.0:1788841352.212396:0:24716:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788841352.212420:0:24716:0:(import.c:65:import_set_state_nolock()) ffffa04a47837000 : changing import state from RECOVER to FULL 00010000:00020000:3.0:1788841352.212428:0:24278:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788841352.212466:0:24716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b491d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3648:x1875735413524736:12345-0@lo:8:kworker.0 Request processed in 223us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841352.212479:0:24278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b491d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3648:x1875735413524864:12345-0@lo:8:kworker.0 Request processed in 145us (358us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788841352.212488:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788841352.212504:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788841352.212507:0:24278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b491d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3648:x1875735413525376:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788841352.212517:0:24278:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788841352.212539:0:24278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b491d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3648:x1875735413525376:12345-0@lo:8:kworker.0 Request processed in 31us (387us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788841352.212545:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788841352.214020:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6d9e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875735413524608:0@lo:400:kworker.0 00010000:00080000:3.0:1788841352.214040:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa04b581a4700 x1875735413525504/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841352.214051:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b581a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875735413525504:0@lo:400:kworker.0 00000100:00100000:3.0:1788841352.214062:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6d9e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a456da20-a415-4617-896c-ee7aa5e4c089:3651:1875735413524480:0@lo:400:kworker.0 00010000:00080000:3.0:1788841352.214074:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa04b581a6300 x1875735413525248/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788841368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841352.214082:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b581a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875735413525248:0@lo:400:kworker.0 00000100:00100000:2.0:1788841352.214601:0:24716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788841352.214655:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa04b581a4380 x1875735413524736/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788841377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841352.214678:0:3648:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788841352.214687:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788841352.214696:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788841352.215165:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788841352.215172:0:3648:0:(import.c:65:import_set_state_nolock()) ffffa04b5210f000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788841352.215204:0:3648:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788841352.215212:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b581a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875735413524736:0@lo:8:kworker.0 00000004:00080000:1.0:1788841352.215318:0:22796:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788841352.215419:0:22796:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 786409585408ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788841352.215440:0:22796:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1788841352.215713:0:22797:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:3.0:1788841352.215739:0:22797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fb84e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22797:1875735413526016:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788841352.215821:0:22797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841352.215881:0:22797:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b50dc80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788841352.215898:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413526016 00000100:00100000:3.0:1788841352.215904:0:24278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413526016 00000100:00100000:3.0:1788841352.215961:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788841352.215972:0:24278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7fb87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22797:x1875735413526016:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:3.0:1788841352.216301:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788841352.216320:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fb86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875735413525888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788841352.216354:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788841352.216692:0:3648:0:(import.c:65:import_set_state_nolock()) ffffa04a47d02000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788841352.216757:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788841352.216762:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b581a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875735413524864:0@lo:8:kworker.0 00000100:00080000:2.0:1788841352.216787:0:3648:0:(import.c:65:import_set_state_nolock()) ffffa04b7cea3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788841352.216792:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788841352.216795:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b581a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875735413525376:0@lo:8:kworker.0 00000100:00100000:1.0:1788841352.217233:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413525888 00000100:00100000:1.0:1788841352.217249:0:24280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413525888 00000100:00100000:1.0:1788841352.217298:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788841352.217308:0:24280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7fb85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3651:x1875735413525888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788841352.217330:0:24280:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788841352.217452:0:24280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7fb85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3651:x1875735413525888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841352.217459:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788841352.219323:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa04b7fb86680 x1875735413525888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841368 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788841352.219368:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fb86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875735413525888:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1788841352.225297:0:22752:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:0.0:1788841352.226259:0:24278:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1788841352.226270:0:24278:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:0.0:1788841352.226277:0:24278:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:65) 00002000:00010000:2.0:1788841352.237744:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788841352.237756:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011b3a4c2/0x5757cd208ac38330 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841352.237774:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=786s v=(0 0) 00010000:00010000:2.0:1788841352.237780:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788841352.237788:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011b3a4c2/0x5757cd208ac38330 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841352.237864:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011b3a4c2/0x5757cd208ac38330 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841352.237879:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011b3a4c2/0x5757cd208ac38330 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841352.237889:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011b3a4c2/0x5757cd208ac38330 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841352.237917:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788841352.238005:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788841352.238014:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011b3a4c2/0x5757cd208ac38330 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.238025:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b81b5cc00 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:1.0:1788841352.238030:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011b3a4c2/0x5757cd208ac38330 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.238040:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011b3a4c2/0x5757cd208ac38330 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.238070:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011b3a4c2/0x5757cd208ac38330 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.238078:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011b3a4c2/0x5757cd208ac38330 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.238122:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841352.238124:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841352.238125:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788841352.238428:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788841352.238434:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012fdea42/0x5757cd208ac38337 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841352.238443:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=786s v=(0 0) 00010000:00010000:2.0:1788841352.238446:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788841352.238451:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012fdea42/0x5757cd208ac38337 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841352.238459:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012fdea42/0x5757cd208ac38337 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841352.238467:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012fdea42/0x5757cd208ac38337 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841352.238486:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012fdea42/0x5757cd208ac38337 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841352.238510:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788841352.238856:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788841352.238863:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012fdea42/0x5757cd208ac38337 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.238872:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b81b5de00 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:1.0:1788841352.238876:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012fdea42/0x5757cd208ac38337 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.238884:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012fdea42/0x5757cd208ac38337 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.238897:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012fdea42/0x5757cd208ac38337 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.238904:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012fdea42/0x5757cd208ac38337 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.238932:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841352.238934:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841352.238936:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788841352.239261:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788841352.239268:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d01dd66/0x5757cd208ac3833e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841352.239278:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=786s v=(0 0) 00010000:00010000:2.0:1788841352.239282:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788841352.239287:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d01dd66/0x5757cd208ac3833e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841352.239299:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d01dd66/0x5757cd208ac3833e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841352.239309:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d01dd66/0x5757cd208ac3833e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841352.239317:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d01dd66/0x5757cd208ac3833e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841352.239341:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788841352.240017:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788841352.240025:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d01dd66/0x5757cd208ac3833e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.240048:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b81b5dc00 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:1.0:1788841352.240062:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d01dd66/0x5757cd208ac3833e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.240072:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d01dd66/0x5757cd208ac3833e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.240087:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d01dd66/0x5757cd208ac3833e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.240099:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d01dd66/0x5757cd208ac3833e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788841352.240120:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788841352.240121:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841352.240124:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841352.240128:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841352.240131:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b1cf906/0x5757cd208ac38345 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841352.240148:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=786s v=(0 0) 00010000:00010000:2.0:1788841352.240152:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788841352.240156:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b1cf906/0x5757cd208ac38345 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841352.240166:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b1cf906/0x5757cd208ac38345 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841352.240175:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b1cf906/0x5757cd208ac38345 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841352.240181:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b1cf906/0x5757cd208ac38345 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841352.240203:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788841352.240270:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788841352.240276:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b1cf906/0x5757cd208ac38345 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.240283:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b81b5c200 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:1.0:1788841352.240286:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b1cf906/0x5757cd208ac38345 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.240295:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b1cf906/0x5757cd208ac38345 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.240312:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b1cf906/0x5757cd208ac38345 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.240319:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b1cf906/0x5757cd208ac38345 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.240332:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841352.240333:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841352.240335:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788841352.241918:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788841352.241929:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f1e187c/0x5757cd208ac3834c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841352.241944:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=786s v=(0 0) 00010000:00010000:2.0:1788841352.241948:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788841352.241954:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f1e187c/0x5757cd208ac3834c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841352.241965:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f1e187c/0x5757cd208ac3834c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841352.241985:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f1e187c/0x5757cd208ac3834c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841352.241992:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f1e187c/0x5757cd208ac3834c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841352.242013:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788841352.242027:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788841352.242035:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f1e187c/0x5757cd208ac3834c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.242045:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b67bb2c00 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:1.0:1788841352.242057:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f1e187c/0x5757cd208ac3834c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.242068:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f1e187c/0x5757cd208ac3834c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.242084:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f1e187c/0x5757cd208ac3834c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.242092:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f1e187c/0x5757cd208ac3834c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.242130:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841352.242132:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841352.242134:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788841352.243815:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788841352.243826:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b1f86b3/0x5757cd208ac38353 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841352.243857:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=786s v=(0 0) 00010000:00010000:2.0:1788841352.243870:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788841352.243877:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b1f86b3/0x5757cd208ac38353 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841352.243890:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b1f86b3/0x5757cd208ac38353 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841352.243899:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b1f86b3/0x5757cd208ac38353 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841352.243906:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b1f86b3/0x5757cd208ac38353 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841352.243936:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788841352.245214:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788841352.245226:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b1f86b3/0x5757cd208ac38353 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.245240:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b67bb2800 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:1.0:1788841352.245245:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b1f86b3/0x5757cd208ac38353 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.245256:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b1f86b3/0x5757cd208ac38353 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.245277:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b1f86b3/0x5757cd208ac38353 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.245286:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b1f86b3/0x5757cd208ac38353 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.245305:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841352.245307:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841352.245309:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788841352.248720:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788841352.248746:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed5d70c3/0x5757cd208ac3835a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.248765:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=786s v=(0 0) 00010000:00010000:0.0:1788841352.248771:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788841352.248777:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed5d70c3/0x5757cd208ac3835a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.248804:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed5d70c3/0x5757cd208ac3835a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.248816:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed5d70c3/0x5757cd208ac3835a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.248824:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed5d70c3/0x5757cd208ac3835a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.248869:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788841352.249383:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788841352.249392:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed5d70c3/0x5757cd208ac3835a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.249413:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a474ae600 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:1.0:1788841352.249418:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed5d70c3/0x5757cd208ac3835a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.249441:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed5d70c3/0x5757cd208ac3835a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.249460:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed5d70c3/0x5757cd208ac3835a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.249467:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed5d70c3/0x5757cd208ac3835a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.249486:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841352.249488:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841352.249490:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788841352.250398:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788841352.250410:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdd01697/0x5757cd208ac38361 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.250494:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=786s v=(0 0) 00010000:00010000:0.0:1788841352.250501:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788841352.250508:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdd01697/0x5757cd208ac38361 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.250521:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdd01697/0x5757cd208ac38361 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.250536:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdd01697/0x5757cd208ac38361 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.250544:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdd01697/0x5757cd208ac38361 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.250566:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788841352.251026:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788841352.251034:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdd01697/0x5757cd208ac38361 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.251042:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a474ae400 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:1.0:1788841352.251046:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdd01697/0x5757cd208ac38361 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.251063:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdd01697/0x5757cd208ac38361 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.251086:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdd01697/0x5757cd208ac38361 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.251211:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdd01697/0x5757cd208ac38361 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.251231:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841352.251233:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841352.251235:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788841352.251364:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788841352.251370:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2c5a6ea/0x5757cd208ac38368 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.251379:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=786s v=(0 0) 00010000:00010000:0.0:1788841352.251382:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788841352.251387:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2c5a6ea/0x5757cd208ac38368 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.251398:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2c5a6ea/0x5757cd208ac38368 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.251406:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2c5a6ea/0x5757cd208ac38368 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.251413:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2c5a6ea/0x5757cd208ac38368 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.253405:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788841352.254203:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788841352.254213:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2c5a6ea/0x5757cd208ac38368 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.254225:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a474ae000 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:1.0:1788841352.254231:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2c5a6ea/0x5757cd208ac38368 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.254241:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2c5a6ea/0x5757cd208ac38368 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.254260:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2c5a6ea/0x5757cd208ac38368 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.254267:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2c5a6ea/0x5757cd208ac38368 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.254300:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841352.254302:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841352.254303:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788841352.255129:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788841352.255140:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098235c9a/0x5757cd208ac3836f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.255155:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=786s v=(0 0) 00010000:00010000:0.0:1788841352.255159:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788841352.255166:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098235c9a/0x5757cd208ac3836f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.255179:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098235c9a/0x5757cd208ac3836f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.255188:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098235c9a/0x5757cd208ac3836f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.255196:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098235c9a/0x5757cd208ac3836f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.255220:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788841352.255387:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788841352.255394:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098235c9a/0x5757cd208ac3836f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.255402:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a474aea00 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:1.0:1788841352.255406:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098235c9a/0x5757cd208ac3836f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.255414:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098235c9a/0x5757cd208ac3836f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.255429:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098235c9a/0x5757cd208ac3836f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.255436:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098235c9a/0x5757cd208ac3836f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.255450:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841352.255451:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841352.255452:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788841352.256458:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788841352.256469:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bc286ad/0x5757cd208ac38376 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.256483:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=786s v=(0 0) 00010000:00010000:0.0:1788841352.256494:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788841352.256501:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005bc286ad/0x5757cd208ac38376 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.256512:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005bc286ad/0x5757cd208ac38376 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.256522:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bc286ad/0x5757cd208ac38376 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.256530:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005bc286ad/0x5757cd208ac38376 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.256591:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788841352.258547:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788841352.258559:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed5d70c3/0x5757cd208ac3837d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.258577:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=786s v=(0 0) 00010000:00010000:0.0:1788841352.258581:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788841352.258587:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed5d70c3/0x5757cd208ac3837d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.258600:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed5d70c3/0x5757cd208ac3837d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.258611:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed5d70c3/0x5757cd208ac3837d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.258626:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed5d70c3/0x5757cd208ac3837d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.258714:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788841352.258723:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005bc286ad/0x5757cd208ac38376 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.258743:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a474ae200 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:1.0:1788841352.258747:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005bc286ad/0x5757cd208ac38376 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.258757:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005bc286ad/0x5757cd208ac38376 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.258773:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005bc286ad/0x5757cd208ac38376 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.258781:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005bc286ad/0x5757cd208ac38376 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.258811:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788841352.258815:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed5d70c3/0x5757cd208ac3837d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.258822:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a474ae600 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:1.0:1788841352.258826:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed5d70c3/0x5757cd208ac3837d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.258848:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed5d70c3/0x5757cd208ac3837d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.258858:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed5d70c3/0x5757cd208ac3837d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.258885:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841352.258886:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841352.258888:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841352.259664:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788841352.259673:0:24278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed5d70c3/0x5757cd208ac3837d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.260410:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788841352.261319:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788841352.261330:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094932e7d/0x5757cd208ac38384 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.261348:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=786s v=(0 0) 00010000:00010000:0.0:1788841352.261358:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788841352.261365:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094932e7d/0x5757cd208ac38384 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.261380:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094932e7d/0x5757cd208ac38384 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.261390:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094932e7d/0x5757cd208ac38384 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.261399:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094932e7d/0x5757cd208ac38384 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.261475:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788841352.261517:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788841352.261524:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094932e7d/0x5757cd208ac38384 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.261532:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a474af400 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:1.0:1788841352.261537:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094932e7d/0x5757cd208ac38384 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.261546:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094932e7d/0x5757cd208ac38384 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.261562:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094932e7d/0x5757cd208ac38384 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.261569:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094932e7d/0x5757cd208ac38384 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.261586:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841352.261588:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841352.261590:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788841352.262029:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788841352.262036:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000199b3341/0x5757cd208ac3838b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.262056:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=786s v=(0 0) 00010000:00010000:0.0:1788841352.262060:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788841352.262066:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000199b3341/0x5757cd208ac3838b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.262084:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000199b3341/0x5757cd208ac3838b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.262242:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000199b3341/0x5757cd208ac3838b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.262251:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000199b3341/0x5757cd208ac3838b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.262270:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788841352.262314:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788841352.262319:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000199b3341/0x5757cd208ac3838b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.262336:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a47cad600 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:1.0:1788841352.262339:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000199b3341/0x5757cd208ac3838b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.262347:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000199b3341/0x5757cd208ac3838b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.262359:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000199b3341/0x5757cd208ac3838b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.262367:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000199b3341/0x5757cd208ac3838b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.262381:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841352.262383:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841352.262385:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788841352.262497:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788841352.262503:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000526c6333/0x5757cd208ac38392 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.262510:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=786s v=(0 0) 00010000:00010000:0.0:1788841352.262519:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788841352.262524:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000526c6333/0x5757cd208ac38392 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.262532:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000526c6333/0x5757cd208ac38392 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.262540:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000526c6333/0x5757cd208ac38392 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.262547:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000526c6333/0x5757cd208ac38392 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.262571:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788841352.262679:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788841352.262684:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000526c6333/0x5757cd208ac38392 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.262692:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a47cac000 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:1.0:1788841352.262696:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000526c6333/0x5757cd208ac38392 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.262706:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000526c6333/0x5757cd208ac38392 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.262805:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000526c6333/0x5757cd208ac38392 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.262814:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000526c6333/0x5757cd208ac38392 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.262830:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841352.262905:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841352.262907:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788841352.263432:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788841352.263440:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000536af1e8/0x5757cd208ac38399 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.263451:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=786s v=(0 0) 00010000:00010000:0.0:1788841352.263455:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788841352.263461:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000536af1e8/0x5757cd208ac38399 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.263472:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000536af1e8/0x5757cd208ac38399 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.263481:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000536af1e8/0x5757cd208ac38399 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.263495:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000536af1e8/0x5757cd208ac38399 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.263515:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788841352.263698:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788841352.263704:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000536af1e8/0x5757cd208ac38399 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.263712:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a47cadc00 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:1.0:1788841352.263715:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000536af1e8/0x5757cd208ac38399 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.263811:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000536af1e8/0x5757cd208ac38399 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.263824:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000536af1e8/0x5757cd208ac38399 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.263987:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000536af1e8/0x5757cd208ac38399 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.264015:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841352.264017:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841352.264019:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788841352.264610:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788841352.264618:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4b31b5b/0x5757cd208ac383a0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.264631:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=786s v=(0 0) 00010000:00010000:0.0:1788841352.264635:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788841352.264641:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4b31b5b/0x5757cd208ac383a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.264653:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4b31b5b/0x5757cd208ac383a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.264662:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4b31b5b/0x5757cd208ac383a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.264671:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4b31b5b/0x5757cd208ac383a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.264814:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788841352.265428:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788841352.265435:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035bf3b9f/0x5757cd208ac383a7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.265452:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=786s v=(0 0) 00010000:00010000:0.0:1788841352.265456:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788841352.265461:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035bf3b9f/0x5757cd208ac383a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.265473:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035bf3b9f/0x5757cd208ac383a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.265481:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035bf3b9f/0x5757cd208ac383a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.265488:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000035bf3b9f/0x5757cd208ac383a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.265587:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788841352.265596:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4b31b5b/0x5757cd208ac383a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.265604:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a47cac200 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:1.0:1788841352.265609:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4b31b5b/0x5757cd208ac383a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.265618:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4b31b5b/0x5757cd208ac383a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.265634:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4b31b5b/0x5757cd208ac383a0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.265642:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4b31b5b/0x5757cd208ac383a0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.265661:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788841352.265664:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035bf3b9f/0x5757cd208ac383a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.265671:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a47caca00 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:1.0:1788841352.265681:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035bf3b9f/0x5757cd208ac383a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.265688:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035bf3b9f/0x5757cd208ac383a7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.265699:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035bf3b9f/0x5757cd208ac383a7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.265706:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841352.265707:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841352.265709:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841352.266183:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788841352.266190:0:24278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035bf3b9f/0x5757cd208ac383a7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788841352.266629:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788841352.266636:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa574ef9/0x5757cd208ac383ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.266645:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=786s v=(0 0) 00010000:00010000:0.0:1788841352.266649:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788841352.266655:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa574ef9/0x5757cd208ac383ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.266676:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa574ef9/0x5757cd208ac383ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.266685:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa574ef9/0x5757cd208ac383ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.266693:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa574ef9/0x5757cd208ac383ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.266728:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788841352.266734:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa574ef9/0x5757cd208ac383ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.266741:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a47cac600 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:1.0:1788841352.266745:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa574ef9/0x5757cd208ac383ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.266753:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa574ef9/0x5757cd208ac383ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.266765:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa574ef9/0x5757cd208ac383ae lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.266773:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841352.266781:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841352.266783:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841352.267351:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788841352.267359:0:24278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa574ef9/0x5757cd208ac383ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788841352.267932:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788841352.267940:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008acf3686/0x5757cd208ac383b5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841352.267951:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=786s v=(0 0) 00010000:00010000:2.0:1788841352.267955:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788841352.267961:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008acf3686/0x5757cd208ac383b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841352.267972:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008acf3686/0x5757cd208ac383b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841352.267980:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008acf3686/0x5757cd208ac383b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841352.267987:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008acf3686/0x5757cd208ac383b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.271171:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788841352.271188:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008acf3686/0x5757cd208ac383b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.271203:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b67bb3200 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:1.0:1788841352.271209:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008acf3686/0x5757cd208ac383b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.271222:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008acf3686/0x5757cd208ac383b5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.271246:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008acf3686/0x5757cd208ac383b5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.271255:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841352.271256:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841352.271258:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841352.272374:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788841352.272386:0:24278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008acf3686/0x5757cd208ac383b5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.272500:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788841352.275503:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788841352.275518:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0abc2e6/0x5757cd208ac383bc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841352.275539:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=786s v=(0 0) 00010000:00010000:3.0:1788841352.275544:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788841352.275551:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0abc2e6/0x5757cd208ac383bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841352.275566:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0abc2e6/0x5757cd208ac383bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841352.275575:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0abc2e6/0x5757cd208ac383bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841352.275583:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0abc2e6/0x5757cd208ac383bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841352.275645:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788841352.279177:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788841352.279191:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001de7ef50/0x5757cd208ac383c3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841352.279209:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=786s v=(0 0) 00010000:00010000:3.0:1788841352.279214:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788841352.279220:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001de7ef50/0x5757cd208ac383c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841352.279233:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001de7ef50/0x5757cd208ac383c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841352.279243:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001de7ef50/0x5757cd208ac383c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841352.279251:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001de7ef50/0x5757cd208ac383c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.281517:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788841352.281529:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0abc2e6/0x5757cd208ac383bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.281542:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b7a722000 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:1.0:1788841352.281546:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0abc2e6/0x5757cd208ac383bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.281570:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0abc2e6/0x5757cd208ac383bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.281591:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0abc2e6/0x5757cd208ac383bc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.281599:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0abc2e6/0x5757cd208ac383bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.281618:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788841352.281621:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001de7ef50/0x5757cd208ac383c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.281628:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b7a722600 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:1.0:1788841352.281631:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001de7ef50/0x5757cd208ac383c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.281639:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001de7ef50/0x5757cd208ac383c3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.281648:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001de7ef50/0x5757cd208ac383c3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.281655:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841352.281656:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841352.281662:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841352.281729:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788841352.281738:0:24278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001de7ef50/0x5757cd208ac383c3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.282023:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788841352.283961:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788841352.283973:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022201c97/0x5757cd208ac383ca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841352.283989:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=786s v=(0 0) 00010000:00010000:3.0:1788841352.284006:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788841352.284013:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022201c97/0x5757cd208ac383ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841352.284026:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022201c97/0x5757cd208ac383ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841352.284036:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022201c97/0x5757cd208ac383ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841352.284042:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022201c97/0x5757cd208ac383ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841352.284284:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788841352.284520:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788841352.284528:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022201c97/0x5757cd208ac383ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.284537:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b7a722400 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:1.0:1788841352.284541:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022201c97/0x5757cd208ac383ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.284550:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022201c97/0x5757cd208ac383ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.284566:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022201c97/0x5757cd208ac383ca lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.284572:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022201c97/0x5757cd208ac383ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.284589:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841352.284591:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841352.284593:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788841352.290213:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788841352.290227:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa574ef9/0x5757cd208ac383d1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.290246:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=786s v=(0 0) 00010000:00010000:0.0:1788841352.290250:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788841352.290256:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa574ef9/0x5757cd208ac383d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.290270:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa574ef9/0x5757cd208ac383d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.290301:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa574ef9/0x5757cd208ac383d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.290309:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa574ef9/0x5757cd208ac383d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.290329:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788841352.290681:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788841352.290689:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa574ef9/0x5757cd208ac383d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841352.290699:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a47cac600 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:3.0:1788841352.290704:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa574ef9/0x5757cd208ac383d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841352.290713:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa574ef9/0x5757cd208ac383d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841352.290744:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa574ef9/0x5757cd208ac383d1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841352.290764:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa574ef9/0x5757cd208ac383d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841352.290784:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841352.290786:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841352.290788:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788841352.291441:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788841352.291451:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035bf3b9f/0x5757cd208ac383d8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.291461:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=786s v=(0 0) 00010000:00010000:0.0:1788841352.291466:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788841352.291471:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035bf3b9f/0x5757cd208ac383d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.291480:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035bf3b9f/0x5757cd208ac383d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.291488:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035bf3b9f/0x5757cd208ac383d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.291495:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000035bf3b9f/0x5757cd208ac383d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.291528:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788841352.291672:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788841352.291679:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035bf3b9f/0x5757cd208ac383d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841352.291693:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a47caca00 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:2.0:1788841352.291697:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035bf3b9f/0x5757cd208ac383d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841352.291703:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035bf3b9f/0x5757cd208ac383d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841352.291726:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035bf3b9f/0x5757cd208ac383d8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841352.291735:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035bf3b9f/0x5757cd208ac383d8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841352.291750:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841352.291752:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841352.291754:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788841352.292285:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788841352.292294:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c4944e2/0x5757cd208ac383df lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.292304:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=786s v=(0 0) 00010000:00010000:0.0:1788841352.292307:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788841352.292313:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c4944e2/0x5757cd208ac383df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.292323:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c4944e2/0x5757cd208ac383df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.292331:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c4944e2/0x5757cd208ac383df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.292337:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c4944e2/0x5757cd208ac383df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.292392:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788841352.296249:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788841352.296266:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd849164/0x5757cd208ac383e6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.296285:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=786s v=(0 0) 00010000:00010000:1.0:1788841352.296291:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788841352.296305:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd849164/0x5757cd208ac383e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.296322:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd849164/0x5757cd208ac383e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.296333:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd849164/0x5757cd208ac383e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.296339:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd849164/0x5757cd208ac383e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841352.296403:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788841352.296411:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c4944e2/0x5757cd208ac383df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841352.296420:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a47cac800 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:3.0:1788841352.296424:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c4944e2/0x5757cd208ac383df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841352.296433:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c4944e2/0x5757cd208ac383df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841352.296450:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c4944e2/0x5757cd208ac383df lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841352.296457:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c4944e2/0x5757cd208ac383df lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841352.296476:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788841352.296480:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd849164/0x5757cd208ac383e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841352.296496:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b48dc7e00 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:3.0:1788841352.296500:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd849164/0x5757cd208ac383e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841352.296507:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd849164/0x5757cd208ac383e6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841352.296517:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd849164/0x5757cd208ac383e6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841352.296524:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841352.296525:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841352.296527:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841352.296601:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788841352.296606:0:24278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd849164/0x5757cd208ac383e6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788841352.298788:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788841352.298815:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000956f358e/0x5757cd208ac383ed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.298856:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=786s v=(0 0) 00010000:00010000:1.0:1788841352.298870:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788841352.298877:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000956f358e/0x5757cd208ac383ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.298892:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000956f358e/0x5757cd208ac383ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.299149:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000956f358e/0x5757cd208ac383ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.299159:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000956f358e/0x5757cd208ac383ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841352.302740:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788841352.302756:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000956f358e/0x5757cd208ac383ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841352.302770:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b48dc6200 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:2.0:1788841352.302775:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000956f358e/0x5757cd208ac383ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841352.302786:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000956f358e/0x5757cd208ac383ed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841352.302850:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000956f358e/0x5757cd208ac383ed lrc: 2/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841352.302868:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841352.302870:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841352.302872:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841352.303210:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788841352.303218:0:24278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000956f358e/0x5757cd208ac383ed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841352.303295:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788841352.304243:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788841352.304253:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024db88f4/0x5757cd208ac383f4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.304270:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=786s v=(0 0) 00010000:00010000:0.0:1788841352.304283:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788841352.304291:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024db88f4/0x5757cd208ac383f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.304306:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024db88f4/0x5757cd208ac383f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.304315:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024db88f4/0x5757cd208ac383f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.304323:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024db88f4/0x5757cd208ac383f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.304339:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788841352.304690:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788841352.304696:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000281a5941/0x5757cd208ac383fb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.304704:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=786s v=(0 0) 00010000:00010000:0.0:1788841352.304708:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788841352.304712:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000281a5941/0x5757cd208ac383fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.304804:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000281a5941/0x5757cd208ac383fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.304814:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000281a5941/0x5757cd208ac383fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.304855:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000281a5941/0x5757cd208ac383fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.305025:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788841352.305380:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788841352.305387:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000230b5c0f/0x5757cd208ac38402 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.305397:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=786s v=(0 0) 00010000:00010000:0.0:1788841352.305400:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788841352.305406:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000230b5c0f/0x5757cd208ac38402 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.305415:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000230b5c0f/0x5757cd208ac38402 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.305423:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000230b5c0f/0x5757cd208ac38402 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.305430:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000230b5c0f/0x5757cd208ac38402 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.305439:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788841352.305656:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788841352.305664:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024db88f4/0x5757cd208ac383f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.305673:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a47cad000 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:1.0:1788841352.305678:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024db88f4/0x5757cd208ac383f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.305688:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024db88f4/0x5757cd208ac383f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.305704:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024db88f4/0x5757cd208ac383f4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.305712:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024db88f4/0x5757cd208ac383f4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.305823:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788841352.305827:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000281a5941/0x5757cd208ac383fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.305861:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a47cac400 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:1.0:1788841352.306240:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000281a5941/0x5757cd208ac383fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.306251:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000281a5941/0x5757cd208ac383fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.306261:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000281a5941/0x5757cd208ac383fb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.306268:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000281a5941/0x5757cd208ac383fb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.306282:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788841352.306286:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000230b5c0f/0x5757cd208ac38402 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.306292:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a47cace00 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:1.0:1788841352.306295:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000230b5c0f/0x5757cd208ac38402 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.306315:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000230b5c0f/0x5757cd208ac38402 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.306326:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000230b5c0f/0x5757cd208ac38402 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.306334:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000230b5c0f/0x5757cd208ac38402 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.306347:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841352.306349:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841352.306351:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841352.306413:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788841352.306526:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788841352.306532:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001496368/0x5757cd208ac38409 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.306549:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=786s v=(0 0) 00010000:00010000:0.0:1788841352.306553:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788841352.306557:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001496368/0x5757cd208ac38409 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.306566:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001496368/0x5757cd208ac38409 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.306574:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001496368/0x5757cd208ac38409 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.306582:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001496368/0x5757cd208ac38409 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841352.306634:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1788841352.306989:0:24278:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:0.0:1788841352.307236:0:24278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7fb87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22797:x1875735413526016:12345-0@lo:5:osp-pre-0-0.0 Request processed in 91262us (91410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841352.307246:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788841352.307752:0:22797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fb84e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22797:1875735413526016:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788841352.307769:0:22797:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:2.0:1788841352.307871:0:22797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b491d0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22797:1875735413526144:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788841352.307913:0:22797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841352.307952:0:22797:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b429d8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788841352.308179:0:24716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413526144 00000100:00100000:3.0:1788841352.308188:0:24716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413526144 00000100:00100000:3.0:1788841352.308235:0:24716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788841352.308244:0:24716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b491d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22797:x1875735413526144:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788841352.308283:0:24716:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00010000:00010000:1.0:1788841352.313539:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788841352.313556:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001496368/0x5757cd208ac38409 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.313572:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a47cada00 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:1.0:1788841352.313578:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001496368/0x5757cd208ac38409 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.313589:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001496368/0x5757cd208ac38409 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.313611:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001496368/0x5757cd208ac38409 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.313638:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001496368/0x5757cd208ac38409 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841352.313662:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841352.313664:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841352.313666:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788841352.315561:0:24274:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:0.0:1788841352.315623:0:24274:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788841352.316307:0:24716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b491d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22797:x1875735413526144:12345-0@lo:5:osp-pre-0-0.0 Request processed in 8059us (8387us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1788841352.316318:0:24716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788841352.316401:0:22797:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:0.0:1788841352.316410:0:22797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b491d0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22797:1875735413526144:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788841352.316426:0:22797:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00010000:00010000:3.0:1788841352.526786:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788841353.494965:0:23525:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788841353.550794:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788841353.617625:0:25092:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788841353.617630:0:25092:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788841353.617631:0:25092:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788841353.617746:0:25092:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffffa04b7fe3a000 00000020:01000004:3.0:1788841353.617763:0:25092:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788841353.617795:0:25092:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788841353.617811:0:25092:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffffa04b527d3370) 00000020:00000080:3.0:1788841353.617829:0:25092:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788841353.701136:0:25092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788841353.705114:0:25092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788841353.705880:0:25092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788841353.706095:0:25092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788841353.706329:0:25092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788841353.706739:0:25092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788841353.707078:0:25092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:2.0:1788841353.708419:0:25092:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788841353.708807:0:25092:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788841353.708823:0:25092:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788841353.709043:0:25092:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5757cd208ac38417 00000020:01000004:2.0:1788841353.709051:0:25092:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788841353.709075:0:25092:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.107@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788841353.709079:0:25092:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.107@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788841353.709086:0:25092:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788841353.709116:0:25092:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1788841353.709121:0:25092:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.107@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788841353.721989:0:25092:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.107@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788841353.722039:0:25092:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.107@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788841353.722044:0:25092:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788841353.722046:0:25092:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788841353.722047:0:25092:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788841353.722048:0:25092:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788841353.722049:0:25092:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788841353.722050:0:25092:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788841353.722052:0:25092:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788841353.722054:0:25092:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788841353.722056:0:25092:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788841353.722059:0:25092:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788841353.722062:0:25092:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788841353.722063:0:25092:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788841353.722064:0:25092:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788841353.722065:0:25092:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788841353.722066:0:25092:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788841353.722067:0:25092:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788841353.722068:0:25092:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788841353.722069:0:25092:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788841353.722070:0:25092:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788841353.722100:0:25092:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788841353.722124:0:25092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b491d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:25092:1875735413526272:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788841353.722209:0:25092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841353.722269:0:25092:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b7f57cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788841353.722364:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413526272 00000100:00100000:3.0:1788841353.722372:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413526272 00000100:00100000:3.0:1788841353.722438:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788841353.722447:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a4696bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+21:25092:x1875735413526272:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788841353.722482:0:22766:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788841353.722485:0:22766:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1788841353.722489:0:22766:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788841353.723406:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a4696bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+21:25092:x1875735413526272:12345-0@lo:253:mount.lustre.0 Request processed in 956us (1193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841353.723415:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788841353.723521:0:25092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b491d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:25092:1875735413526272:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788841353.723534:0:25092:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788841353.723538:0:25092:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788841353.723539:0:25092:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788841353.723540:0:25092:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788841353.723542:0:25092:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788841353.723543:0:25092:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788841353.723544:0:25092:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788841353.723545:0:25092:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788841353.723547:0:25092:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788841353.723548:0:25092:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788841353.723578:0:25092:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa04b7fe3a000 from lustre-OST0001 10000000:01000000:0.0:1788841353.723633:0:25092:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788841353.723636:0:25092:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788841353.723644:0:25092:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffffa04b6e03cd28 local copy 00010000:00010000:0.0:1788841353.723654:0:25092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04a474afa00/0x5757cd208ac3804a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac38051 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841353.723748:0:25092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fa05880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:25092:1875735413526400:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788841353.723791:0:25092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841353.723826:0:25092:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b7ddb0000 going to sleep for 11 seconds 00000100:00100000:3.0:1788841353.724081:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413526400 00000100:00100000:3.0:1788841353.724087:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413526400 00000100:00100000:3.0:1788841353.724127:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788841353.724136:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a4696a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+21:25092:x1875735413526400:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788841353.724200:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a4696a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+21:25092:x1875735413526400:12345-0@lo:501:mount.lustre.0 Request processed in 65us (408us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788841353.724207:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788841353.724369:0:25092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fa05880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:25092:1875735413526400:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788841353.724384:0:25092:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.107@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788841353.724403:0:25092:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.107@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788841353.724410:0:25092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04a474afa00/0x5757cd208ac3804a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac38051 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841353.724418:0:25092:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.107@tcp lock: ffffa04a474afa00/0x5757cd208ac3804a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac38051 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788841353.724448:0:25092:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa04b7fe3a000 10000000:01000000:0.0:1788841353.724461:0:25092:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788841353.724466:0:25092:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788841353.724469:0:25092:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788841353.724473:0:25092:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788841353.724476:0:25092:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788841353.724500:0:25092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04a47cac400/0x5757cd208ac3841e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841353.724508:0:25092:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.107@tcp lock: ffffa04a47cac400/0x5757cd208ac3841e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841353.724518:0:25092:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.107@tcp lock: ffffa04a47cac400/0x5757cd208ac3841e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841353.724532:0:25092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fa05880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:25092:1875735413526528:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788841353.724561:0:25092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841353.724743:0:25092:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b7ddb0000 going to sleep for 11 seconds 00000100:00100000:3.0:1788841353.724804:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413526528 00000100:00100000:3.0:1788841353.724814:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413526528 00000100:00100000:3.0:1788841353.724862:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788841353.724869:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a46968c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+21:25092:x1875735413526528:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788841353.724878:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788841353.724891:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa04b7a722600/0x5757cd208ac38425 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5757cd208ac3841e expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841353.724911:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa04b7a722600/0x5757cd208ac38425 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5757cd208ac3841e expref: 22 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841353.724922:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa04b7a722600/0x5757cd208ac38425 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5757cd208ac3841e expref: 22 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841353.724931:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04b7a722600, rc 0) 00000100:00100000:3.0:1788841353.724965:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a46968c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+22:25092:x1875735413526528:12345-0@lo:101:mount.lustre.0 Request processed in 98us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841353.724970:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788841353.725142:0:25092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fa05880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:25092:1875735413526528:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788841353.725155:0:25092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.107@tcp lock: ffffa04a47cac400/0x5757cd208ac3841e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac38425 expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841353.725164:0:25092:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.107@tcp lock: ffffa04a47cac400/0x5757cd208ac3841e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5757cd208ac38425 expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788841353.726205:0:25092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:0.0:1788841353.727074:0:25092:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788841353.729272:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1788841353.729322:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:0.0:1788841353.729335:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:0.0:1788841353.729413:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:0.0:1788841353.729437:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:0.0:1788841353.729448:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:0.0:1788841353.729459:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:0.0:1788841353.729469:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:0.0:1788841353.729480:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:0.0:1788841353.729499:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:0.0:1788841353.729504:0:25092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:0.0:1788841353.729727:0:25092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fa05880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:25092:1875735413526656:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788841353.729810:0:25092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841353.730118:0:25092:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b7ddb0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788841353.730176:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413526656 00000100:00100000:3.0:1788841353.730184:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413526656 00000100:00100000:3.0:1788841353.730251:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788841353.730260:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a46969050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+22:25092:x1875735413526656:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788841353.730399:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a46969050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+22:25092:x1875735413526656:12345-0@lo:501:mount.lustre.0 Request processed in 140us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841353.730406:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788841353.730468:0:25092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fa05880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:25092:1875735413526656:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788841353.730497:0:25092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fa05880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:25092:1875735413526784:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788841353.730532:0:25092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841353.730784:0:25092:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b7ddb0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788841353.730973:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413526784 00000100:00100000:2.0:1788841353.730978:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413526784 00000100:00100000:2.0:1788841353.731001:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788841353.731007:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a4696b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+22:25092:x1875735413526784:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788841353.735433:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a4696b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+22:25092:x1875735413526784:12345-0@lo:503:mount.lustre.0 Request processed in 4416us (4890us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841353.735446:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788841353.736141:0:25092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fa05880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:25092:1875735413526784:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788841353.736746:0:25092:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788841353.736940:0:25092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fb84e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:25092:1875735413526912:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788841353.737008:0:25092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841353.737045:0:25092:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b7d0f79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788841353.737168:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413526912 00000100:00100000:0.0:1788841353.737175:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413526912 00000100:00100000:0.0:1788841353.737216:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788841353.737225:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a46968850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+22:25092:x1875735413526912:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788841353.738129:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a46968850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+22:25092:x1875735413526912:12345-0@lo:502:mount.lustre.0 Request processed in 901us (1117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841353.738138:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788841353.738278:0:25092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fb84e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:25092:1875735413526912:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788841353.738552:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1788841353.738707:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1788841353.738724:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1788841353.738737:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1788841353.738750:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1788841353.738763:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1788841353.738788:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1788841353.738803:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1788841353.738815:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:0.0:1788841353.739168:0:25092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b581a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:25092:1875735413527040:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788841353.739223:0:25092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841353.739284:0:25092:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b7ddb0240 going to sleep for 11 seconds 00000100:00100000:1.0:1788841353.739318:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413527040 00000100:00100000:1.0:1788841353.739324:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413527040 00000100:00100000:1.0:1788841353.739445:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788841353.739454:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7060d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+22:25092:x1875735413527040:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788841353.740756:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7060d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+22:25092:x1875735413527040:12345-0@lo:502:mount.lustre.0 Request processed in 1298us (1527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841353.740777:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788841353.741163:0:25092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b581a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:25092:1875735413527040:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788841353.741254:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:0.0:1788841353.741277:0:25092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:3.0:1788841353.743045:0:25096:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788841353.743056:0:25096:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1788841353.743063:0:25096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788841353.743066:0:25096:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788841353.743072:0:25096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788841353.743088:0:25096:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffffa04b527d19b8) 00000020:00000080:3.0:1788841353.743115:0:25096:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788841353.743120:0:25096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788841353.743201:0:25096:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa04b7fe3a000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788841353.743209:0:25096:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788841353.743215:0:25096:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5757cd208ac38433 00010000:00010000:3.0:1788841353.747757:0:25096:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1788841353.748432:0:25096:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934599 00080000:10000000:3.0:1788841353.750394:0:25096:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1788841353.752149:0:25096:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788841353.752161:0:25096:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788841353.752167:0:25096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788841353.752169:0:25096:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788841353.752172:0:25096:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788841353.752176:0:25096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788841353.752178:0:25096:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788841353.752180:0:25096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788841353.752182:0:25096:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788841353.752184:0:25096:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788841353.752186:0:25096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788841353.752187:0:25096:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788841353.752189:0:25096:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788841353.752191:0:25096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788841353.752192:0:25096:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788841353.752195:0:25096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788841353.752231:0:25096:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788841353.752233:0:25096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788841353.752235:0:25096:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788841353.752238:0:25096:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:1.0:1788841353.752383:0:25092:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1788841353.752419:0:25092:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.107@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788841353.752442:0:25092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04a47cac400/0x5757cd208ac3841e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac38425 expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841353.752458:0:25092:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.107@tcp lock: ffffa04a47cac400/0x5757cd208ac3841e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac38425 expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788841353.752466:0:25092:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa04b7fe3a000 from 1 10000000:01000000:1.0:1788841353.752468:0:25092:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788841353.752500:0:25092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b48dc7e00/0x5757cd208ac3843a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841353.752508:0:25092:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.107@tcp lock: ffffa04b48dc7e00/0x5757cd208ac3843a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841353.752518:0:25092:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.107@tcp lock: ffffa04b48dc7e00/0x5757cd208ac3843a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841353.752541:0:25092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b581a4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:25092:1875735413527168:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788841353.752681:0:25092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841353.752729:0:25092:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b5212ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1788841353.752977:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413527168 00000100:00100000:2.0:1788841353.752985:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413527168 00000100:00100000:2.0:1788841353.753037:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788841353.753051:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7060e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+22:25092:x1875735413527168:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788841353.753064:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841353.753075:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa04b67bb3800/0x5757cd208ac38441 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5757cd208ac3843a expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841353.753097:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa04b67bb3800/0x5757cd208ac38441 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5757cd208ac3843a expref: 23 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841353.753108:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa04b67bb3800/0x5757cd208ac38441 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5757cd208ac3843a expref: 23 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841353.753116:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04b67bb3800, rc 0) 00000100:00100000:2.0:1788841353.753694:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7060e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+23:25092:x1875735413527168:12345-0@lo:101:mount.lustre.0 Request processed in 643us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841353.753701:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788841353.753756:0:25092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b581a4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:25092:1875735413527168:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788841353.753782:0:25092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.107@tcp lock: ffffa04b48dc7e00/0x5757cd208ac3843a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac38441 expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841353.753793:0:25092:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.107@tcp lock: ffffa04b48dc7e00/0x5757cd208ac3843a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5757cd208ac38441 expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788841353.755757:0:25092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:2.0:1788841353.756131:0:25092:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788841353.756326:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1788841353.756351:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1788841353.756365:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1788841353.756378:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1788841353.756391:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1788841353.756412:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1788841353.756424:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1788841353.756435:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1788841353.756446:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1788841353.756456:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:2.0:1788841353.756469:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:2.0:1788841353.756485:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:2.0:1788841353.756489:0:25092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:2.0:1788841353.756564:0:25092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b491d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:25092:1875735413527296:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788841353.756707:0:25092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841353.756810:0:25092:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b7f57c240 going to sleep for 11 seconds 00000100:00100000:1.0:1788841353.757036:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413527296 00000100:00100000:1.0:1788841353.757044:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413527296 00000100:00100000:1.0:1788841353.757165:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788841353.757175:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7060cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+23:25092:x1875735413527296:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788841353.757296:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7060cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+23:25092:x1875735413527296:12345-0@lo:501:mount.lustre.0 Request processed in 122us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841353.757304:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788841353.757378:0:25092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b491d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:25092:1875735413527296:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788841353.757414:0:25092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fb86680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:25092:1875735413527424:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788841353.757452:0:25092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841353.757585:0:25092:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b5f75c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788841353.757668:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413527424 00000100:00100000:0.0:1788841353.757672:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413527424 00000100:00100000:0.0:1788841353.757742:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788841353.757750:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7060c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+23:25092:x1875735413527424:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788841353.758026:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7060c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+23:25092:x1875735413527424:12345-0@lo:503:mount.lustre.0 Request processed in 276us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841353.758033:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788841353.758147:0:25092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fb86680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:25092:1875735413527424:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788841353.758530:0:25092:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788841353.758672:0:25092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fb86680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:25092:1875735413527552:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788841353.758716:0:25092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841353.758819:0:25092:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b5f75c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788841353.759436:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413527552 00000100:00100000:1.0:1788841353.759442:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413527552 00000100:00100000:0.0:1788841353.759580:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788841353.759588:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7060c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+23:25092:x1875735413527552:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788841353.759699:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7060c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+23:25092:x1875735413527552:12345-0@lo:502:mount.lustre.0 Request processed in 111us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841353.759705:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788841353.759798:0:25092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fb86680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:25092:1875735413527552:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788841353.760031:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1788841353.760057:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:1.0:1788841353.760069:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:1.0:1788841353.760089:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:1.0:1788841353.760105:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:1.0:1788841353.760119:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:1.0:1788841353.760131:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:1.0:1788841353.760144:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:1.0:1788841353.760162:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:1.0:1788841353.760177:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:1.0:1788841353.760190:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:1.0:1788841353.760216:0:25092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b581a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:25092:1875735413527680:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788841353.760258:0:25092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841353.760294:0:25092:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b5212e180 going to sleep for 11 seconds 00000100:00100000:2.0:1788841353.760584:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413527680 00000100:00100000:2.0:1788841353.760589:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413527680 00000100:00100000:2.0:1788841353.760626:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788841353.760634:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7060e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+23:25092:x1875735413527680:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788841353.760733:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7060e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+23:25092:x1875735413527680:12345-0@lo:502:mount.lustre.0 Request processed in 97us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841353.760740:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788841353.761244:0:25092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b581a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:25092:1875735413527680:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788841353.761312:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:1.0:1788841353.761322:0:25092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788841353.762469:0:25100:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788841353.762480:0:25100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788841353.762482:0:25100:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788841353.762489:0:25100:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa04b7fe3a000 00000020:00000080:3.0:1788841353.762491:0:25100:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788841353.762499:0:25100:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788841353.762501:0:25100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788841353.762503:0:25100:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788841353.762505:0:25100:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788841353.762507:0:25100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788841353.762509:0:25100:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788841353.762512:0:25100:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa04b7fe3a000 00000020:00000080:3.0:1788841353.762514:0:25100:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788841353.762573:0:25100:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788841353.762576:0:25100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788841353.762578:0:25100:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788841353.762580:0:25100:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788841353.762590:0:25100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788841353.762591:0:25100:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788841353.762595:0:25100:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa04b7fe3a000 00000020:00000080:3.0:1788841353.762597:0:25100:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788841353.762828:0:25100:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788841353.762952:0:25100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788841353.762954:0:25100:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788841353.762959:0:25100:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788841353.762961:0:25100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788841353.762963:0:25100:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788841353.762966:0:25100:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa04b7fe3a000 00000020:00000080:3.0:1788841353.762968:0:25100:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788841353.762995:0:25100:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788841353.762998:0:25100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788841353.762999:0:25100:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788841353.763002:0:25100:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:1.0:1788841353.763214:0:25092:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788841353.763243:0:25092:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.107@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788841353.763267:0:25092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b48dc7e00/0x5757cd208ac3843a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac38441 expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841353.763278:0:25092:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.107@tcp lock: ffffa04b48dc7e00/0x5757cd208ac3843a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac38441 expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788841353.763327:0:25092:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788841353.763330:0:25092:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa04b7fe3a000 10000000:01000000:1.0:1788841353.763333:0:25092:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa04b7fe3a000 10000000:01000000:1.0:1788841353.763337:0:25092:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788841353.763347:0:25092:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa04b7fe3a000 from 1 10000000:01000000:1.0:1788841353.763350:0:25092:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788841353.763394:0:25092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b48dc7400/0x5757cd208ac38448 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841353.763404:0:25092:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.107@tcp lock: ffffa04b48dc7400/0x5757cd208ac38448 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841353.763415:0:25092:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.107@tcp lock: ffffa04b48dc7400/0x5757cd208ac38448 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841353.763438:0:25092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b581a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:25092:1875735413527808:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788841353.763514:0:25092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841353.763551:0:25092:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b5212e300 going to sleep for 11 seconds 00000100:00100000:1.0:1788841353.764193:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413527808 00000100:00100000:1.0:1788841353.764200:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413527808 00000100:00100000:1.0:1788841353.764246:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788841353.764254:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7060c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+23:25092:x1875735413527808:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788841353.764267:0:22767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788841353.764280:0:22767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa04b48dc6e00/0x5757cd208ac3844f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5757cd208ac38448 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841353.764303:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa04b48dc6e00/0x5757cd208ac3844f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5757cd208ac38448 expref: 24 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841353.764313:0:22767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa04b48dc6e00/0x5757cd208ac3844f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5757cd208ac38448 expref: 24 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841353.764321:0:22767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04b48dc6e00, rc 0) 00000100:00100000:1.0:1788841353.764365:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7060c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+24:25092:x1875735413527808:12345-0@lo:101:mount.lustre.0 Request processed in 111us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841353.764388:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788841353.764439:0:25092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b581a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:25092:1875735413527808:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788841353.764454:0:25092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.107@tcp lock: ffffa04b48dc7400/0x5757cd208ac38448 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac3844f expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841353.764463:0:25092:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.107@tcp lock: ffffa04b48dc7400/0x5757cd208ac38448 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5757cd208ac3844f expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788841353.774403:0:25092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:0.0:1788841353.775268:0:25092:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788841353.775926:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1788841353.775956:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1788841353.775973:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1788841353.775998:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1788841353.776016:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1788841353.776036:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1788841353.776051:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1788841353.776079:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1788841353.776101:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1788841353.776129:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1788841353.776146:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1788841353.776162:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1788841353.776179:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1788841353.776194:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1788841353.776223:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1788841353.776250:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1788841353.776269:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1788841353.776285:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1788841353.776301:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1788841353.776336:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1788841353.776351:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1788841353.776364:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1788841353.776377:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1788841353.776392:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1788841353.776419:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:0.0:1788841353.776439:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:0.0:1788841353.776468:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:0.0:1788841353.776488:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:0.0:1788841353.776505:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:0.0:1788841353.776521:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:0.0:1788841353.776535:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:0.0:1788841353.776548:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:0.0:1788841353.776563:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:0.0:1788841353.776577:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:0.0:1788841353.776591:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:0.0:1788841353.776618:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:0.0:1788841353.776634:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:0.0:1788841353.776648:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:0.0:1788841353.776659:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:0.0:1788841353.776672:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:0.0:1788841353.776688:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:0.0:1788841353.776715:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:0.0:1788841353.776733:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:0.0:1788841353.776751:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:0.0:1788841353.779347:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:0.0:1788841353.779402:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:0.0:1788841353.779420:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:0.0:1788841353.779940:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:0.0:1788841353.780130:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:0.0:1788841353.780157:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:0.0:1788841353.780198:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:0.0:1788841353.780206:0:25092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:0.0:1788841353.781191:0:25092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fa06300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:25092:1875735413527936:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788841353.781268:0:25092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841353.781302:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413527936 00000100:00100000:3.0:1788841353.781311:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413527936 00000100:00100000:0.0:1788841353.781315:0:25092:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04a4789a180 going to sleep for 11 seconds 00000100:00100000:3.0:1788841353.781432:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788841353.781443:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7060f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+24:25092:x1875735413527936:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788841353.781573:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7060f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+24:25092:x1875735413527936:12345-0@lo:501:mount.lustre.0 Request processed in 131us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841353.781581:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788841353.781620:0:25092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fa06300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:25092:1875735413527936:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788841353.781664:0:25092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fa06300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:25092:1875735413528064:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788841353.781704:0:25092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841353.781725:0:25092:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04a4789a180 going to sleep for 11 seconds 00000100:00100000:3.0:1788841353.781962:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413528064 00000100:00100000:3.0:1788841353.781967:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413528064 00000100:00100000:3.0:1788841353.782004:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788841353.782012:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7060d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+24:25092:x1875735413528064:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788841353.782105:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7060d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+24:25092:x1875735413528064:12345-0@lo:503:mount.lustre.0 Request processed in 93us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841353.782112:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788841353.782335:0:25092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fa06300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:25092:1875735413528064:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788841353.782746:0:25092:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788841353.782992:0:25092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fa06300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:25092:1875735413528192:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788841353.783037:0:25092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841353.783072:0:25092:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04a4789a180 going to sleep for 11 seconds 00000100:00100000:3.0:1788841353.783438:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413528192 00000100:00100000:3.0:1788841353.783445:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413528192 00000100:00100000:3.0:1788841353.783489:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788841353.783499:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7060ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+24:25092:x1875735413528192:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788841353.783667:0:25092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fa06300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:25092:1875735413528192:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788841353.783673:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7060ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+24:25092:x1875735413528192:12345-0@lo:502:mount.lustre.0 Request processed in 176us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841353.783681:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000040:00080000:1.0:1788841353.783973:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1788841353.784013:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1788841353.784026:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1788841353.784037:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1788841353.784049:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1788841353.784060:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1788841353.784071:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1788841353.784082:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1788841353.784092:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1788841353.784102:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1788841353.784114:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1788841353.784125:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1788841353.784136:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1788841353.784147:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1788841353.784158:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1788841353.784168:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1788841353.784194:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1788841353.784208:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1788841353.784219:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1788841353.784230:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1788841353.784250:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1788841353.784263:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1788841353.784274:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1788841353.784285:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1788841353.784294:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:1.0:1788841353.784304:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:1.0:1788841353.784315:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:1.0:1788841353.784326:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:1.0:1788841353.784336:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:1.0:1788841353.784346:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:1.0:1788841353.784358:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:1.0:1788841353.784370:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:1.0:1788841353.784394:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:1.0:1788841353.784410:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:1.0:1788841353.784424:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:1.0:1788841353.784434:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:1.0:1788841353.784444:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:1.0:1788841353.784454:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:1.0:1788841353.784464:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:1.0:1788841353.784475:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:1.0:1788841353.784485:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:1.0:1788841353.784497:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:1.0:1788841353.784508:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:1.0:1788841353.784520:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:1.0:1788841353.784531:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:1.0:1788841353.784541:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:1.0:1788841353.784553:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:1.0:1788841353.784783:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:1.0:1788841353.785001:0:25092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b581a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:25092:1875735413528320:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788841353.785185:0:25092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841353.785222:0:25092:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b5212e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788841353.785282:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413528320 00000100:00100000:1.0:1788841353.785289:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413528320 00000100:00100000:1.0:1788841353.785328:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788841353.785342:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7060f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+24:25092:x1875735413528320:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788841353.785441:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7060f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+24:25092:x1875735413528320:12345-0@lo:502:mount.lustre.0 Request processed in 100us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841353.785448:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788841353.785541:0:25092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b581a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:25092:1875735413528320:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788841353.785706:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:0.0:1788841353.785735:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:0.0:1788841353.785762:0:25092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fa04380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:25092:1875735413528448:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788841353.785822:0:25092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841353.785863:0:25092:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04a4789ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1788841353.785954:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413528448 00000100:00100000:1.0:1788841353.785959:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413528448 00000100:00100000:1.0:1788841353.785990:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788841353.785998:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7060fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+24:25092:x1875735413528448:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788841353.786067:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7060fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+24:25092:x1875735413528448:12345-0@lo:502:mount.lustre.0 Request processed in 70us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841353.786074:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788841353.786247:0:25092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fa04380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:25092:1875735413528448:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788841353.786295:0:25092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:0.0:1788841353.786304:0:25092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788841353.786982:0:25105:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788841353.786999:0:25105:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffffa04b46de8000) 00000020:00000080:0.0:1788841353.787023:0:25105:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:0.0:1788841353.787121:0:25105:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa04b7fe3a000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788841353.787126:0:25105:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa04b7fe3a000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788841353.787129:0:25105:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa04b7fe3a000 3 00010000:00080000:0.0:1788841353.787162:0:25105:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa04a4784e800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.107@tcp at head 00010000:00010000:0.0:1788841353.789039:0:25105:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:0.0:1788841353.789297:0:25105:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788841353.789344:0:25105:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788841353.789357:0:25105:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x5757cd208ac3845d 00000100:00080000:0.0:1788841353.789367:0:25105:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788841353.789372:0:25105:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffffa04a4784e800 using connection 192.168.204.107@tcp/0@lo 00000100:00100000:0.0:1788841353.789406:0:25105:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa04b7fa04380 x1875735413528576/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788841353.789431:0:25105:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788841353.790036:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fa04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1875735413528576:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788841353.790563:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788841353.792656:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788841353.792662:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788841353.792666:0:37:0:(import.c:65:import_set_state_nolock()) ffffa04a47d02000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788841353.792674:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 786 00000100:00080000:2.0:1788841353.792679:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788841353.792687:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa04a47d02000 using connection 192.168.204.107@tcp/0@lo 00000100:00100000:3.0:1788841353.792695:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b491d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875735413528704:0@lo:400:kworker.0 00000100:00100000:2.0:1788841353.792710:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa04a47cbf480 x1875735413528960/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788841353.792764:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788841353.792779:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00100000:3.0:1788841353.792784:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788841353.792784:0:37:0:(import.c:65:import_set_state_nolock()) ffffa04b7cea3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788841353.792792:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 786 00000100:00080000:2.0:1788841353.792796:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788841353.792801:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffffa04b7cea3800 using connection 192.168.204.107@tcp/0@lo 00000100:00100000:2.0:1788841353.792815:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa04a47cbce00 x1875735413529472/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788841353.792855:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47cbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875735413529344:0@lo:400:kworker.0 00000100:00100000:2.0:1788841353.792883:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47cbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875735413529216:0@lo:400:kworker.0 00000100:00100000:2.0:1788841353.792916:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841353.792937:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47cbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875735413529856:0@lo:400:kworker.0 00000100:00100000:3.0:1788841353.792962:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841353.792972:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841353.793017:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413529344 00000100:00100000:3.0:1788841353.793024:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413529344 00000100:00100000:3.0:1788841353.793080:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788841353.793089:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7fb85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875735413529344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841353.793182:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47cbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875735413528832:0@lo:400:kworker.0 00000100:00100000:2.0:1788841353.793211:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841353.793227:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47cbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875735413529600:0@lo:400:kworker.0 00000100:00100000:2.0:1788841353.793247:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841353.793262:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788841353.793267:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47cbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875735413529088:0@lo:400:kworker.0 00000100:00100000:2.0:1788841353.793288:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841353.793304:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47cbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875735413529728:0@lo:400:kworker.0 00000100:00100000:2.0:1788841353.793324:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841353.793351:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413528704 00000100:00100000:2.0:1788841353.793355:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413528704 00000100:00100000:2.0:1788841353.793377:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413529216 00000100:00100000:2.0:1788841353.793386:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413529216 00000100:00100000:2.0:1788841353.793403:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788841353.793409:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7fb84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875735413528704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841353.793467:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7fb84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875735413528704:12345-0@lo:400:kworker.0 Request processed in 56us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841353.793474:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788841353.793490:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788841353.793496:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47cbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875735413529216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841353.793527:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47cbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875735413529216:12345-0@lo:400:kworker.0 Request processed in 30us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841353.793533:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788841353.793568:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413528576 00000100:00100000:0.0:1788841353.793574:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413528576 00000100:00100000:0.0:1788841353.793592:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413529856 00000100:00100000:0.0:1788841353.793595:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413529856 00000100:00100000:0.0:1788841353.793610:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413529600 00000100:00100000:0.0:1788841353.793613:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413529600 00000100:00100000:0.0:1788841353.793624:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413529088 00000100:00100000:0.0:1788841353.793626:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413529088 00000100:00100000:0.0:1788841353.793636:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413529728 00000100:00100000:0.0:1788841353.793638:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413529728 00000100:00100000:0.0:1788841353.794547:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788841353.794564:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47cbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875735413529856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841353.794630:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47cbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875735413529856:12345-0@lo:400:kworker.0 Request processed in 72us (1658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841353.794638:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788841353.794661:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788841353.794668:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47cbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875735413529600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841353.795935:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7fb85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875735413529344:12345-0@lo:400:kworker.0 Request processed in 2841us (2968us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841353.795995:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788841353.796028:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413528832 00000100:00100000:3.0:1788841353.796035:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413528832 00000100:00100000:3.0:1788841353.796074:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788841353.796082:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47cbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875735413528832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841353.798030:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788841353.798041:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b491d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1875735413528576:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788841353.798059:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47cbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875735413529600:12345-0@lo:400:kworker.0 Request processed in 3388us (4807us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841353.798069:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1788841353.798075:0:22772:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 787 last 0 00000100:00100000:0.0:1788841353.798100:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788841353.798111:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47cbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875735413529088:12345-0@lo:400:kworker.0 00000020:00000080:2.0:1788841353.798132:0:22772:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x5757cd208ac38464 00000004:00100000:2.0:1788841353.798151:0:22772:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1788841353.798173:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47cbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875735413529088:12345-0@lo:400:kworker.0 Request processed in 64us (4881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841353.798180:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1788841353.798186:0:22772:0:(import.c:65:import_set_state_nolock()) ffffa04b7d55b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788841353.798196:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788841353.798205:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47cbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875735413529728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841353.798240:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b491d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875735413528576:12345-0@lo:38:llog_process_th.0 Request processed in 197us (7676us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841353.798251:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788841353.798252:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47cbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875735413529728:12345-0@lo:400:kworker.0 Request processed in 45us (4923us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841353.798262:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788841353.798305:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47cbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875735413528960:0@lo:8:kworker.0 00000100:00100000:2.0:1788841353.798351:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:1.0:1788841353.798353:0:25105:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788841353.798371:0:25105:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffffa04b6e054d28) 00000100:00100000:2.0:1788841353.798386:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47cbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875735413529472:0@lo:8:kworker.0 00000020:00000080:1.0:1788841353.798393:0:25105:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000100:00100000:3.0:1788841353.798457:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47cbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875735413528832:12345-0@lo:400:kworker.0 Request processed in 2374us (5243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841353.798466:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788841353.798484:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413528960 00000100:00100000:3.0:1788841353.798489:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413528960 00000100:00100000:3.0:1788841353.798533:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788841353.798537:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3648:x1875735413528960:12345-0@lo:8:kworker.0 00000020:01000004:1.0:1788841353.798568:0:25105:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa04b7fe3a000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788841353.798574:0:25105:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa04b7fe3a000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788841353.798577:0:25105:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa04b7fe3a000 3 00000100:00100000:3.0:1788841353.798582:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3648:x1875735413528960:12345-0@lo:8:kworker.0 Request processed in 41us (231us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788841353.798591:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1788841353.798610:0:25105:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa04a4784b800@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.107@tcp at head 00000100:00080000:3.0:1788841353.798612:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788841353.798619:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788841353.798623:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788841353.798718:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788841353.798761:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa04b7fa04380 x1875735413528576/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788841363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841353.798791:0:3648:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788841353.798799:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1788841353.798808:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788841353.798811:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788841353.798814:0:3648:0:(import.c:65:import_set_state_nolock()) ffffa04a4784e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788841353.798821:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fa04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1875735413528576:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788841353.798985:0:3648:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788841353.798990:0:3648:0:(import.c:65:import_set_state_nolock()) ffffa04a47d02000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788841353.798994:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788841353.798997:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47cbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875735413528960:0@lo:8:kworker.0 00000100:00100000:0.0:1788841353.799082:0:24279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413529472 00000100:00100000:0.0:1788841353.799088:0:24279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413529472 00000100:00100000:0.0:1788841353.799121:0:24279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788841353.799127:0:24279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47cbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3648:x1875735413529472:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788841353.799168:0:24279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47cbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3648:x1875735413529472:12345-0@lo:8:kworker.0 Request processed in 40us (451us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788841353.799175:0:24279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788841353.799207:0:3648:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788841353.799211:0:3648:0:(import.c:65:import_set_state_nolock()) ffffa04b7cea3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788841353.799215:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788841353.799218:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47cbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875735413529472:0@lo:8:kworker.0 00000100:00100000:2.0:1788841353.800581:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47cbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875735413529216:0@lo:400:kworker.0 00010000:00080000:2.0:1788841353.800599:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa04a47cbf100 x1875735413529856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841353.800611:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47cbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875735413529856:0@lo:400:kworker.0 00010000:00080000:2.0:1788841353.800730:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa04a47cbdf80 x1875735413529088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841353.800742:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47cbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875735413529088:0@lo:400:kworker.0 00010000:00080000:2.0:1788841353.800755:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa04a47cbd880 x1875735413529728/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841353.800764:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47cbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875735413529728:0@lo:400:kworker.0 00000100:00100000:2.0:1788841353.800787:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47cbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875735413528832:0@lo:400:kworker.0 00010000:00080000:2.0:1788841353.800810:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa04a47cbca80 x1875735413529600/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841353.800820:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47cbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875735413529600:0@lo:400:kworker.0 00000100:00100000:2.0:1788841353.800870:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47cbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875735413529344:0@lo:400:kworker.0 00000100:00100000:2.0:1788841353.800882:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b491d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875735413528704:0@lo:400:kworker.0 00010000:00010000:1.0:1788841353.802991:0:25105:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:1.0:1788841353.804642:0:25105:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1788841353.804696:0:25105:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788841353.804711:0:25105:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x5757cd208ac38472 00000100:00080000:1.0:1788841353.804723:0:25105:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788841353.804731:0:25105:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffffa04a4784b800 using connection 192.168.204.107@tcp/0@lo 00000100:00100000:1.0:1788841353.805028:0:25105:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa04b581a7480 x1875735413529984/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788841353.805055:0:25105:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788841353.805208:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b581a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3648:1875735413529984:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788841353.805287:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841353.805987:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413529984 00000100:00100000:1.0:1788841353.805996:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413529984 00000100:00100000:1.0:1788841353.806043:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788841353.806053:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7fa06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1875735413529984:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788841353.806082:0:22772:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 787 last 0 00000020:00000080:1.0:1788841353.806134:0:22772:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x5757cd208ac38479 00000004:00100000:1.0:1788841353.806151:0:22772:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788841353.806199:0:22772:0:(import.c:65:import_set_state_nolock()) ffffa04a41b66000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788841353.806273:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7fa06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875735413529984:12345-0@lo:38:llog_process_th.0 Request processed in 221us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841353.806280:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1788841353.806424:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788841353.806429:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788841353.806431:0:37:0:(import.c:65:import_set_state_nolock()) ffffa04a47d02000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788841353.806439:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa04a47d02000 using connection 192.168.204.107@tcp/0@lo 00000100:00100000:3.0:1788841353.806456:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa04b7fb86680 x1875735413530496/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788841353.806483:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788841353.806486:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788841353.806488:0:37:0:(import.c:65:import_set_state_nolock()) ffffa04b7cea3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788841353.806492:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffffa04b7cea3800 using connection 192.168.204.107@tcp/0@lo 00000100:00100000:3.0:1788841353.806504:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa04b6e05e680 x1875735413531008/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788841353.806533:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788841353.806537:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788841353.807759:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fb86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875735413530368:0@lo:400:kworker.0 00000100:00100000:2.0:1788841353.807855:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1788841353.807988:0:25105:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:3.0:1788841353.808052:0:25092:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788841353.808080:0:25092:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.107@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788841353.808096:0:25092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b48dc7400/0x5757cd208ac38448 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac3844f expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841353.808115:0:25092:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.107@tcp lock: ffffa04b48dc7400/0x5757cd208ac38448 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac3844f expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788841353.808161:0:25092:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788841353.808165:0:25092:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788841353.808166:0:25092:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788841353.808167:0:25092:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788841353.808169:0:25092:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788841353.808170:0:25092:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788841353.808172:0:25092:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788841353.808173:0:25092:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788841353.808175:0:25092:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788841353.808179:0:25092:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1788841353.808182:0:25092:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788841353.808183:0:25092:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788841353.808184:0:25092:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788841353.808185:0:25092:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788841353.808186:0:25092:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788841353.808187:0:25092:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788841353.808188:0:25092:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788841353.808189:0:25092:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788841353.808191:0:25092:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788841353.808211:0:25092:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788841353.808226:0:25092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:25092:1875735413531648:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788841353.808266:0:25092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841353.808301:0:25092:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b5f7e23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788841353.808322:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413531648 00000100:00100000:3.0:1788841353.808327:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413531648 00000100:00100000:3.0:1788841353.808375:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788841353.808689:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7060dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+24:25092:x1875735413531648:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788841353.808882:0:22767:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788841353.808899:0:22767:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788841353.808910:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875735413531136:0@lo:400:kworker.0 00000100:00100000:2.0:1788841353.808961:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841353.809001:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788841353.809003:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413531136 00000100:00100000:1.0:1788841353.809009:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413531136 00000100:00100000:1.0:1788841353.809047:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788841353.809056:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47cbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875735413531136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841353.809106:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47cbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875735413531136:12345-0@lo:400:kworker.0 Request processed in 52us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841353.809115:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788841353.809381:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fb87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875735413530240:0@lo:400:kworker.0 00000100:00100000:2.0:1788841353.809416:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841353.809438:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6d9e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875735413530880:0@lo:400:kworker.0 00000100:00100000:2.0:1788841353.809461:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841353.809480:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1875735413531520:0@lo:400:kworker.0 00000100:00100000:2.0:1788841353.809500:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788841353.809540:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa04b6e05ca80 x1875735413531136/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841353.809555:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875735413531136:0@lo:400:kworker.0 00000100:00100000:2.0:1788841353.809589:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413530368 00000100:00100000:2.0:1788841353.809593:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413530368 00000100:00100000:2.0:1788841353.809629:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413530880 00000100:00100000:2.0:1788841353.809632:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413530880 00000100:00100000:1.0:1788841353.809656:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413531520 00000100:00100000:1.0:1788841353.809661:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413531520 00000100:00100000:2.0:1788841353.809679:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788841353.809689:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788841353.809692:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47cbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875735413530368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841353.809704:0:24278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47cbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875735413530880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841353.809708:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788841353.809723:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875735413531520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841353.809746:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47cbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875735413530368:12345-0@lo:400:kworker.0 Request processed in 59us (1891us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841353.809754:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788841353.809911:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fb84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875735413530624:0@lo:400:kworker.0 00000100:00080000:3.0:1788841353.809976:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788841353.811230:0:24278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47cbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875735413530880:12345-0@lo:400:kworker.0 Request processed in 1528us (1763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841353.811242:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788841353.811254:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fb85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a456da20-a415-4617-896c-ee7aa5e4c089:3652:1875735413530112:0@lo:400:kworker.0 00000100:00100000:3.0:1788841353.811312:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841353.811328:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875735413531520:12345-0@lo:400:kworker.0 Request processed in 1607us (1825us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841353.811337:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788841353.811355:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6d9e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875735413530752:0@lo:400:kworker.0 00000100:00100000:2.0:1788841353.811381:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841353.811393:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841353.811432:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1875735413531392:0@lo:400:kworker.0 00000100:00100000:2.0:1788841353.811446:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1875735413531264:0@lo:400:kworker.0 00000100:00100000:2.0:1788841353.811477:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841353.811494:0:25016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413530624 00000100:00100000:1.0:1788841353.811502:0:25016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413530624 00000100:00100000:2.0:1788841353.811518:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413531264 00000100:00100000:2.0:1788841353.811523:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413531264 00000100:00100000:1.0:1788841353.811558:0:25016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788841353.811566:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788841353.811578:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47cbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875735413531264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841353.811592:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413530240 00000100:00100000:2.0:1788841353.811597:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413530240 00000100:00100000:2.0:1788841353.811621:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413530752 00000100:00100000:2.0:1788841353.811624:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413530752 00000100:00100000:2.0:1788841353.811641:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788841353.811643:0:25016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47cbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875735413530624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841353.811650:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875735413530240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841353.811696:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875735413530240:12345-0@lo:400:kworker.0 Request processed in 48us (2279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841353.811702:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788841353.811714:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788841353.811720:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6e05ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875735413530752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841353.811744:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6e05ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875735413530752:12345-0@lo:400:kworker.0 Request processed in 25us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841353.811750:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788841353.811929:0:25016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47cbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875735413530624:12345-0@lo:400:kworker.0 Request processed in 364us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841353.811936:0:25016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788841353.812048:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841353.812088:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6d9e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875735413530752:0@lo:400:kworker.0 00000100:00100000:3.0:1788841353.812112:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413530112 00000100:00100000:3.0:1788841353.812116:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413530112 00000100:00100000:3.0:1788841353.812144:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788841353.812150:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7060d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+25:3652:x1875735413530112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841353.812184:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7060d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+25:3652:x1875735413530112:12345-0@lo:400:kworker.0 Request processed in 34us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841353.812190:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788841353.812266:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47cbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875735413531264:12345-0@lo:400:kworker.0 Request processed in 690us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841353.812275:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788841353.812290:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413531392 00000100:00100000:0.0:1788841353.812294:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413531392 00000100:00100000:3.0:1788841353.812315:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fb86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875735413530496:0@lo:8:kworker.0 00000100:00100000:0.0:1788841353.812323:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788841353.812331:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6e05e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875735413531392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841353.812353:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841353.812429:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fb87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875735413530240:0@lo:400:kworker.0 00000100:00100000:2.0:1788841353.812458:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6d9e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875735413530880:0@lo:400:kworker.0 00010000:00080000:2.0:1788841353.812471:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa04b6e05c000 x1875735413531520/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841353.812483:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1875735413531520:0@lo:400:kworker.0 00000100:00100000:2.0:1788841353.812500:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fb86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875735413530368:0@lo:400:kworker.0 00000100:00100000:2.0:1788841353.812667:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413530496 00000100:00100000:2.0:1788841353.812672:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413530496 00000100:00100000:2.0:1788841353.812693:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788841353.812698:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6e05d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3648:x1875735413530496:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788841353.812749:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6e05e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875735413531392:12345-0@lo:400:kworker.0 Request processed in 417us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841353.812757:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1788841353.812950:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa04b7fb84e00 x1875735413530624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788841353.812963:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fb84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875735413530624:0@lo:400:kworker.0 00010000:00080000:1.0:1788841353.812977:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa04b6e05d500 x1875735413531264/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788841353.812986:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1875735413531264:0@lo:400:kworker.0 00000100:00100000:3.0:1788841353.813183:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875735413531008:0@lo:8:kworker.0 00000100:00100000:3.0:1788841353.813219:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788841353.813315:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa04b581a7480 x1875735413529984/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788841363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841353.813323:0:3648:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788841353.813331:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:3.0:1788841353.813338:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788841353.813343:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788841353.813353:0:3648:0:(import.c:65:import_set_state_nolock()) ffffa04a4784b800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788841353.813360:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b581a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3648:1875735413529984:0@lo:38:llog_process_th.0 20000000:01000000:3.0:1788841353.813418:0:22767:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788841353.813428:0:22767:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788841353.813462:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6e05d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3648:x1875735413530496:12345-0@lo:8:kworker.0 Request processed in 761us (1108us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788841353.813470:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788841353.813484:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413531008 00000100:00100000:2.0:1788841353.813487:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413531008 20000000:01000000:3.0:1788841353.813496:0:22788:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788841353.813501:0:22788:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788841353.813519:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa04b7a722400/0x5757cd208ac38480 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841353.813541:0:22788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa04b7a723c00/0x5757cd208ac3830d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5757cd208ac38306 expref: 24 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841353.813549:0:22788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa04b48dc6000/0x5757cd208ac3831b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5757cd208ac38314 expref: 24 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841353.813557:0:22788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa04b7a722400/0x5757cd208ac38480 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841353.813597:0:22788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa04b48dc6000/0x5757cd208ac3831b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5757cd208ac38314 expref: 24 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841353.813611:0:22788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa04b48dc6000/0x5757cd208ac3831b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5757cd208ac38314 expref: 24 pid: 22764 timeout: 888 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841353.813621:0:22788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22788:1875735413531776:0@lo:104: 00000100:00100000:3.0:1788841353.813735:0:22788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788841353.813796:0:22788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa04b7a723c00/0x5757cd208ac3830d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5757cd208ac38306 expref: 24 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841353.813804:0:22788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa04b7a723c00/0x5757cd208ac3830d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5757cd208ac38306 expref: 24 pid: 22766 timeout: 888 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841353.813819:0:22788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05ca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22788:1875735413531904:0@lo:104: 00000100:00100000:3.0:1788841353.813865:0:22788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841353.813891:0:22788:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b5f7e2900 going to sleep for 11 seconds 00000100:00100000:3.0:1788841353.813905:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413531776 00000100:00100000:3.0:1788841353.813909:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413531776 00000100:00100000:3.0:1788841353.813929:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413531904 00000100:00100000:3.0:1788841353.813932:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413531904 00000100:00100000:3.0:1788841353.813943:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788841353.813950:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6e05c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a456da20-a415-4617-896c-ee7aa5e4c089+4:22788:x1875735413531776:12345-0@lo:104: 00010000:00010000:3.0:1788841353.813962:0:22756:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.107@tcp lock: ffffa04a474aee00/0x5757cd208ac38314 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5757cd208ac3831b expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841353.814007:0:22756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788841353.814012:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6e05c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a456da20-a415-4617-896c-ee7aa5e4c089+4:22788:x1875735413531776:12345-0@lo:104: Request processed in 63us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841353.814017:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788841353.814030:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788841353.814035:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6d9e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a456da20-a415-4617-896c-ee7aa5e4c089+3:22788:x1875735413531904:12345-0@lo:104: 00010000:00010000:3.0:1788841353.814043:0:22756:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.107@tcp lock: ffffa04a474af800/0x5757cd208ac38306 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5757cd208ac3830d expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841353.814073:0:22756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788841353.814077:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6d9e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a456da20-a415-4617-896c-ee7aa5e4c089+3:22788:x1875735413531904:12345-0@lo:104: Request processed in 42us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841353.814082:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1788841353.814100:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788841353.814106:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.107@tcp lock: ffffa04a474aee00/0x5757cd208ac38314 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5757cd208ac3831b expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841353.814119:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a474aee00 already unused, calling callback (ffffffffc11a4c20) 10000000:00010000:3.0:1788841353.814123:0:22761:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.107@tcp lock: ffffa04a474aee00/0x5757cd208ac38314 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5757cd208ac3831b expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841353.814132:0:22761:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.107@tcp lock: ffffa04a474aee00/0x5757cd208ac38314 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5757cd208ac3831b expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788841353.814138:0:22761:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.107@tcp lock: ffffa04a474aee00/0x5757cd208ac38314 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5757cd208ac3831b expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788841353.814144:0:22761:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788841353.814171:0:22761:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.107@tcp lock: ffffa04a474aee00/0x5757cd208ac38314 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5757cd208ac3831b expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841353.814178:0:22761:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788841353.814197:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.107@tcp lock: ffffa04a474aee00/0x5757cd208ac38314 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5757cd208ac3831b expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841353.814204:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.107@tcp lock: ffffa04a474aee00/0x5757cd208ac38314 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5757cd208ac3831b expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841353.814216:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788841353.814220:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.107@tcp lock: ffffa04a474af800/0x5757cd208ac38306 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5757cd208ac3830d expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841353.814225:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a474af800 already unused, calling callback (ffffffffc11a4c20) 10000000:00010000:3.0:1788841353.814227:0:22761:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.107@tcp lock: ffffa04a474af800/0x5757cd208ac38306 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5757cd208ac3830d expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841353.814251:0:22761:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.107@tcp lock: ffffa04a474af800/0x5757cd208ac38306 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5757cd208ac3830d expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788841353.814262:0:22761:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.107@tcp lock: ffffa04a474af800/0x5757cd208ac38306 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5757cd208ac3830d expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788841353.814268:0:22761:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788841353.814286:0:22761:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.107@tcp lock: ffffa04a474af800/0x5757cd208ac38306 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5757cd208ac3830d expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841353.814292:0:22761:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788841353.814304:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.107@tcp lock: ffffa04a474af800/0x5757cd208ac38306 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5757cd208ac3830d expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841353.814311:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.107@tcp lock: ffffa04a474af800/0x5757cd208ac38306 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5757cd208ac3830d expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841353.814323:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841353.814325:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841353.814326:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841353.814332:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841353.814376:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7060dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+24:25092:x1875735413531648:12345-0@lo:253:mount.lustre.0 Request processed in 5988us (6109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841353.814384:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788841353.814427:0:25092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a456da20-a415-4617-896c-ee7aa5e4c089:25092:1875735413531648:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788841353.814438:0:25092:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788841353.814442:0:25092:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788841353.814444:0:25092:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788841353.814446:0:25092:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788841353.814453:0:25092:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788841353.814454:0:25092:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788841353.814455:0:25092:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788841353.814456:0:25092:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788841353.814458:0:25092:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788841353.814460:0:25092:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788841353.814472:0:25092:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788841353.815068:0:22788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22788:1875735413531776:0@lo:104: 00000100:00100000:3.0:1788841353.815077:0:22788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05ca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22788:1875735413531904:0@lo:104: 00010000:00010000:3.0:1788841353.815094:0:22788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa04b7a722400/0x5757cd208ac38480 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841353.815123:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fb85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a456da20-a415-4617-896c-ee7aa5e4c089:3652:1875735413530112:0@lo:400:kworker.0 00010000:00080000:3.0:1788841353.815137:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa04b6e05ed80 x1875735413531392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841353.815147:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1875735413531392:0@lo:400:kworker.0 00000100:00100000:3.0:1788841353.815535:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788841353.815547:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b81b21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a456da20-a415-4617-896c-ee7aa5e4c089:3652:1875735413532160:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788841353.815600:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841353.815646:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413532160 00000100:00100000:3.0:1788841353.815652:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413532160 00010000:00010000:3.0:1788841353.815675:0:22758:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa04b7a723c00/0x5757cd208ac3830d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5757cd208ac38306 expref: 24 pid: 22766 timeout: 888 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841353.815908:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788841353.815917:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b81b22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a456da20-a415-4617-896c-ee7aa5e4c089+24:3652:x1875735413532160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788841353.815930:0:22758:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788841353.815936:0:22758:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa04b7a723c00/0x5757cd208ac3830d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5757cd208ac38306 expref: 24 pid: 22766 timeout: 888 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841353.815953:0:22758:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa04b7a723c00/0x5757cd208ac3830d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5757cd208ac38306 expref: 24 pid: 22766 timeout: 888 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841353.815970:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa04b7a723c00/0x5757cd208ac3830d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5757cd208ac38306 expref: 24 pid: 22766 timeout: 888 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841353.815985:0:22758:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788841353.816019:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b81b22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a456da20-a415-4617-896c-ee7aa5e4c089+23:3652:x1875735413532160:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841353.816026:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788841353.816057:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b81b21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a456da20-a415-4617-896c-ee7aa5e4c089:3652:1875735413532160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788841353.816173:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788841353.816180:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6e05ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3648:x1875735413531008:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788841353.816230:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6e05ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3648:x1875735413531008:12345-0@lo:8:kworker.0 Request processed in 49us (3011us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788841353.816236:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788841353.816923:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6d9e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a456da20-a415-4617-896c-ee7aa5e4c089:3650:1875735413532032:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788841353.816964:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841353.817014:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413532032 00000100:00100000:3.0:1788841353.817019:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413532032 00010000:00010000:3.0:1788841353.817042:0:22757:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa04b48dc6000/0x5757cd208ac3831b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5757cd208ac38314 expref: 23 pid: 22764 timeout: 888 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841353.817066:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788841353.817076:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b81b21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a456da20-a415-4617-896c-ee7aa5e4c089+23:3650:x1875735413532032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788841353.817086:0:22757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788841353.817090:0:22757:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa04b48dc6000/0x5757cd208ac3831b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5757cd208ac38314 expref: 23 pid: 22764 timeout: 888 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841353.817101:0:22757:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa04b48dc6000/0x5757cd208ac3831b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5757cd208ac38314 expref: 23 pid: 22764 timeout: 888 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841353.817127:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa04b48dc6000/0x5757cd208ac3831b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5757cd208ac38314 expref: 23 pid: 22764 timeout: 888 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841353.817140:0:22757:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa04b7a722400/0x5757cd208ac38480 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841353.817148:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa04b7a722400/0x5757cd208ac38480 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788841353.817163:0:22757:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.033455547s 00010000:00010000:3.0:1788841353.817169:0:22757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa04b7a722400/0x5757cd208ac38480 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841353.817176:0:22757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa04b7a722400/0x5757cd208ac38480 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841353.817183:0:22757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa04b7a722400/0x5757cd208ac38480 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841353.817189:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa04b7a722400/0x5757cd208ac38480 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841353.817195:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b7a722400 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:3.0:1788841353.817199:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa04b7a722400/0x5757cd208ac38480 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841353.817207:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa04b7a722400/0x5757cd208ac38480 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841353.817222:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa04b7a722400/0x5757cd208ac38480 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841353.817493:0:22757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788841353.817527:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b81b21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a456da20-a415-4617-896c-ee7aa5e4c089+22:3650:x1875735413532032:12345-0@lo:103:ldlm_bl.0 Request processed in 454us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841353.817534:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1788841353.817558:0:22788:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa04b7a722400/0x5757cd208ac38480 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841353.817566:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa04b7a722400/0x5757cd208ac38480 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841353.817573:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa04b7a722400/0x5757cd208ac38480 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841353.817898:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6d9e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a456da20-a415-4617-896c-ee7aa5e4c089:3650:1875735413532032:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1788841353.817993:0:3648:0:(import.c:65:import_set_state_nolock()) ffffa04a47d02000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788841353.817999:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788841353.818004:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fb86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875735413530496:0@lo:8:kworker.0 00000100:00080000:3.0:1788841353.818018:0:3648:0:(import.c:65:import_set_state_nolock()) ffffa04b7cea3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788841353.818022:0:3648:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788841353.818025:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875735413531008:0@lo:8:kworker.0 00000001:00000004:3.0:1788841353.821487:0:25092:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1788841353.832725:0:25092:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788841353.832738:0:25092:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788841353.833055:0:25092:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788841353.833112:0:25092:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.107@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788841353.833136:0:25092:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1788841353.833174:0:25092:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1788841353.834201:0:25092:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788841353.834449:0:25092:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788841354.573064:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788841354.754464:0:25160:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788841354.754783:0:25160:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1788841355.020953:0:22769:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788841355.020962:0:22769:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa04b521ab000 from 14 10000000:01000000:2.0:1788841355.020967:0:22769:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788841355.021014:0:22769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b67bb2e00/0x5757cd208ac38487 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841355.021026:0:22769:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.107@tcp lock: ffffa04b67bb2e00/0x5757cd208ac38487 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841355.021054:0:22769:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.107@tcp lock: ffffa04b67bb2e00/0x5757cd208ac38487 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841355.021081:0:22769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47cbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413532288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788841355.021153:0:22769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841355.021203:0:22769:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b7ddb06c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788841355.021362:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413532288 00000100:00100000:3.0:1788841355.021370:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413532288 00000100:00100000:3.0:1788841355.021424:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788841355.021433:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47ee7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+22:22769:x1875735413532288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788841355.021453:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788841355.021467:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa04b7a722400/0x5757cd208ac3848e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5757cd208ac38487 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841355.021488:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa04b7a722400/0x5757cd208ac3848e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5757cd208ac38487 expref: 23 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841355.021498:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa04b7a722400/0x5757cd208ac3848e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5757cd208ac38487 expref: 23 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841355.021507:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04b7a722400, rc 0) 00000100:00100000:3.0:1788841355.021551:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47ee7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+23:22769:x1875735413532288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841355.021557:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788841355.021685:0:22769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47cbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413532288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788841355.021699:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.107@tcp lock: ffffa04b67bb2e00/0x5757cd208ac38487 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac3848e expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841355.021708:0:22769:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.107@tcp lock: ffffa04b67bb2e00/0x5757cd208ac38487 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5757cd208ac3848e expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841355.021770:0:22769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47cbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413532416:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788841355.021801:0:22769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841355.021824:0:22769:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b7ddb06c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788841355.022035:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413532416 00000100:00100000:3.0:1788841355.022040:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413532416 00000100:00100000:3.0:1788841355.022077:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788841355.022084:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47ee6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+23:22769:x1875735413532416:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788841355.022098:0:22767:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788841355.022116:0:22767:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788841355.022118:0:22767:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:3.0:1788841355.022200:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47ee6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+23:22769:x1875735413532416:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 116us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841355.022207:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788841355.022278:0:22769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47cbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413532416:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788841355.022342:0:22769:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.107@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788841355.022349:0:22769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b67bb2e00/0x5757cd208ac38487 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac3848e expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841355.022358:0:22769:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.107@tcp lock: ffffa04b67bb2e00/0x5757cd208ac38487 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac3848e expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788841355.022368:0:22769:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788841355.022369:0:22769:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa04a45f80000 from 14 10000000:01000000:2.0:1788841355.022377:0:22769:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788841355.022394:0:22769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b67bb2000/0x5757cd208ac38495 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841355.022402:0:22769:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.107@tcp lock: ffffa04b67bb2000/0x5757cd208ac38495 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841355.022409:0:22769:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.107@tcp lock: ffffa04b67bb2000/0x5757cd208ac38495 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841355.022421:0:22769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47cbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413532544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788841355.022446:0:22769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841355.022476:0:22769:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b7ddb06c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788841355.022530:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413532544 00000100:00100000:0.0:1788841355.022534:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413532544 00000100:00100000:0.0:1788841355.022567:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788841355.022574:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47ee5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+23:22769:x1875735413532544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788841355.022583:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841355.022594:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa04a47cac600/0x5757cd208ac3849c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5757cd208ac38495 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841355.022611:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa04a47cac600/0x5757cd208ac3849c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5757cd208ac38495 expref: 24 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841355.022620:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa04a47cac600/0x5757cd208ac3849c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5757cd208ac38495 expref: 24 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841355.022628:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04a47cac600, rc 0) 00000100:00100000:0.0:1788841355.022677:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47ee5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+24:22769:x1875735413532544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841355.022682:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788841355.022858:0:22769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47cbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413532544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788841355.022872:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.107@tcp lock: ffffa04b67bb2000/0x5757cd208ac38495 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac3849c expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841355.022880:0:22769:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.107@tcp lock: ffffa04b67bb2000/0x5757cd208ac38495 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5757cd208ac3849c expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841355.022919:0:22769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47cbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413532672:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788841355.022949:0:22769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841355.022964:0:22769:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b7ddb06c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788841355.023067:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413532672 00000100:00100000:0.0:1788841355.023071:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413532672 00000100:00100000:0.0:1788841355.023089:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788841355.023095:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47ee4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+24:22769:x1875735413532672:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788841355.023106:0:22764:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788841355.023118:0:22764:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788841355.023121:0:22764:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:0.0:1788841355.023206:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47ee4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+24:22769:x1875735413532672:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 111us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841355.023219:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788841355.023383:0:22769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47cbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413532672:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788841355.023427:0:22769:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.107@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788841355.023433:0:22769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b67bb2000/0x5757cd208ac38495 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac3849c expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841355.023450:0:22769:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.107@tcp lock: ffffa04b67bb2000/0x5757cd208ac38495 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac3849c expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841355.598033:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841356.301551:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788841356.301580:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b81b21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875735413532800:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788841356.301669:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841356.301755:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413532800 00000100:00100000:3.0:1788841356.301765:0:24280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413532800 00000100:00100000:3.0:1788841356.301862:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788841356.301873:0:24280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b81b22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875735413532800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788841356.301911:0:24280:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788841356.301959:0:24280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b81b22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875735413532800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841356.301966:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788841356.301989:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788841356.302031:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b81b21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875735413532800:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788841356.622702:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788841356.813294:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b581a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875735413532928:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788841356.813378:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841356.813451:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788841356.813458:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fa04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875735413533056:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788841356.813482:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841356.813560:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413532928 00000100:00100000:0.0:1788841356.813569:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413532928 00000100:00100000:0.0:1788841356.813608:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413533056 00000100:00100000:0.0:1788841356.813612:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413533056 00000100:00100000:0.0:1788841356.813628:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788841356.813636:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47cbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875735413532928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788841356.813668:0:22778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788841356.813738:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47cbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875735413532928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841356.813745:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788841356.813763:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788841356.813769:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47cbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875735413533056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788841356.813785:0:22778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788841356.813824:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47cbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875735413533056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 55us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841356.813855:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788841356.814318:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fa04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875735413533056:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788841356.814332:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b581a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875735413532928:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788841357.329691:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788841357.329731:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b81b21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875735413533184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788841357.329980:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841357.338697:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413533184 00000100:00100000:1.0:1788841357.338723:0:24280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413533184 00000100:00100000:1.0:1788841357.338932:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788841357.338944:0:24280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b81b20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875735413533184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788841357.338971:0:24280:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788841357.339063:0:24280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b81b20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875735413533184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (9083us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841357.339071:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788841357.339098:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788841357.339149:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b81b21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875735413533184:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788841357.660884:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841358.670065:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788841358.872529:0:22177:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788841358.872535:0:22177:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788841358.872539:0:22177:0:(import.c:65:import_set_state_nolock()) ffffa04a47d02000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788841358.872552:0:22177:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa04a47d02000 using connection 192.168.204.107@tcp/0@lo 00000100:00100000:1.0:1788841358.872561:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fa05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a456da20-a415-4617-896c-ee7aa5e4c089:3652:1875735413533312:0@lo:400:kworker.0 00000100:00100000:0.0:1788841358.872573:0:22177:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa04b7fa07b80 x1875735413533696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788841358.872623:0:22177:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788841358.872626:0:22177:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788841358.872628:0:22177:0:(import.c:65:import_set_state_nolock()) ffffa04b7cea3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788841358.872633:0:22177:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffffa04b7cea3800 using connection 192.168.204.107@tcp/0@lo 00000100:00100000:1.0:1788841358.872641:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841358.872642:0:22177:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa04b7fa05880 x1875735413534208/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788841358.872713:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fa04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875735413533952:0@lo:400:kworker.0 00000100:00100000:0.0:1788841358.872716:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fa04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875735413533824:0@lo:400:kworker.0 00000100:00100000:0.0:1788841358.872742:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841358.872765:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fa06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1875735413534464:0@lo:400:kworker.0 00000100:00100000:0.0:1788841358.872801:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841358.872862:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fa05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875735413533440:0@lo:400:kworker.0 00000100:00100000:0.0:1788841358.872892:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fa07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875735413533568:0@lo:400:kworker.0 00000100:00100000:0.0:1788841358.872913:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841358.872930:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fa04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875735413534336:0@lo:400:kworker.0 00000100:00100000:0.0:1788841358.872947:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841358.872961:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fa05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1875735413534848:0@lo:400:kworker.0 00000100:00100000:0.0:1788841358.872979:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841358.873002:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fa07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875735413533696:0@lo:8:kworker.0 00000100:00100000:0.0:1788841358.873023:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841358.873038:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fa05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875735413534208:0@lo:8:kworker.0 00000100:00100000:0.0:1788841358.873055:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841358.873082:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413533312 00000100:00100000:0.0:1788841358.873094:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413533312 00000100:00100000:0.0:1788841358.873141:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788841358.873151:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47ee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+24:3652:x1875735413533312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841358.873198:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47ee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+24:3652:x1875735413533312:12345-0@lo:400:kworker.0 Request processed in 49us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841358.873206:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788841358.873234:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841358.873244:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413533824 00000100:00100000:0.0:1788841358.873248:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413533824 00000100:00100000:1.0:1788841358.873260:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fa05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1875735413534592:0@lo:400:kworker.0 00000100:00100000:1.0:1788841358.873283:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841358.873667:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fa05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a456da20-a415-4617-896c-ee7aa5e4c089:3652:1875735413533312:0@lo:400:kworker.0 00000100:00100000:1.0:1788841358.873944:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413534464 00000100:00100000:1.0:1788841358.873949:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413534464 00000100:00100000:1.0:1788841358.873978:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413534336 00000100:00100000:1.0:1788841358.873981:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413534336 00000100:00100000:1.0:1788841358.873991:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413534848 00000100:00100000:1.0:1788841358.873994:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413534848 00000100:00100000:1.0:1788841358.874006:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413534592 00000100:00100000:1.0:1788841358.874008:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413534592 00000100:00100000:1.0:1788841358.874021:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788841358.874029:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7fa06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875735413533824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841358.874076:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7fa06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875735413533824:12345-0@lo:400:kworker.0 Request processed in 48us (1334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841358.874082:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788841358.874095:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788841358.874099:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7c02b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875735413534464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841358.874377:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788841358.874385:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7c028380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875735413534336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841358.874423:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7c028380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875735413534336:12345-0@lo:400:kworker.0 Request processed in 40us (1474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841358.874430:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788841358.874444:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788841358.874450:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7f88d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875735413534848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841358.874477:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7f88d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875735413534848:12345-0@lo:400:kworker.0 Request processed in 28us (1496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841358.874483:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788841358.874494:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788841358.874499:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b581a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875735413534592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841358.874530:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b581a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875735413534592:12345-0@lo:400:kworker.0 Request processed in 31us (1246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841358.874536:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788841358.874554:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413533568 00000100:00100000:0.0:1788841358.874558:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413533568 00000100:00100000:0.0:1788841358.874581:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413533696 00000100:00100000:0.0:1788841358.874584:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413533696 00000100:00100000:0.0:1788841358.874601:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413534208 00000100:00100000:0.0:1788841358.874604:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413534208 00000100:00100000:0.0:1788841358.874613:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788841358.874618:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7c02b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875735413533568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841358.874649:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7c02b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875735413533568:12345-0@lo:400:kworker.0 Request processed in 31us (1735us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841358.874655:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788841358.874666:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788841358.874682:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7f88d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3648:x1875735413533696:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788841358.874709:0:24277:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 793 last 0 00000100:00100000:1.0:1788841358.874714:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7c02b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875735413534464:12345-0@lo:400:kworker.0 Request processed in 21us (1319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841358.874722:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000020:00000080:0.0:1788841358.874743:0:24277:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5757cd208ac384a3 00002000:00100000:0.0:1788841358.874757:0:24277:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffffa04a47e01000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113972 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788841358.874761:0:24277:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788841358.874764:0:24277:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1788841358.874822:0:24279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788841358.874828:0:24279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7f88df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3648:x1875735413534208:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788841358.874862:0:24279:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 793 last 0 00000020:00000080:1.0:1788841358.874877:0:24279:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5757cd208ac384aa 00002000:00100000:1.0:1788841358.874889:0:24279:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffffa04a41b62800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113972 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1788841358.874892:0:24279:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1788841358.874894:0:24279:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788841358.875093:0:24279:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1788841358.875118:0:24279:0:(import.c:65:import_set_state_nolock()) ffffa04a41b61000 : changing import state from RECOVER to FULL 00002000:00080000:0.0:1788841358.875909:0:24277:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788841358.875934:0:24277:0:(import.c:65:import_set_state_nolock()) ffffa04a47e01800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788841358.876009:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7f88d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1875735413533696:12345-0@lo:8:kworker.0 Request processed in 1324us (2984us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841358.876018:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788841358.876066:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413533952 00000100:00100000:0.0:1788841358.876073:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413533952 00000100:00100000:0.0:1788841358.876112:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788841358.876120:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b581a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875735413533952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841358.876161:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b581a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875735413533952:12345-0@lo:400:kworker.0 Request processed in 42us (2926us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841358.876167:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788841358.876197:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841358.876243:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fa06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875735413534080:0@lo:400:kworker.0 00000100:00100000:1.0:1788841358.876265:0:24279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7f88df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3648:x1875735413534208:12345-0@lo:8:kworker.0 Request processed in 1437us (3209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841358.876273:0:24279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1788841358.876308:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788841358.876313:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788841358.878575:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841358.878621:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fa04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1875735413534720:0@lo:400:kworker.0 00000100:00100000:0.0:1788841358.878660:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841358.878719:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413533440 00000100:00100000:0.0:1788841358.878726:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413533440 00000100:00100000:0.0:1788841358.878766:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788841358.879371:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7f88c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875735413533440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841358.879442:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7f88c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875735413533440:12345-0@lo:400:kworker.0 Request processed in 76us (3244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841358.879450:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788841358.879480:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413534080 00000100:00100000:0.0:1788841358.879486:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413534080 00000100:00100000:0.0:1788841358.879528:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788841358.879534:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7f88dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875735413534080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841358.879564:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7f88dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875735413534080:12345-0@lo:400:kworker.0 Request processed in 31us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841358.879569:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1788841358.879590:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788841358.879625:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa04b7fa07b80 x1875735413533696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788841383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788841358.879641:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788841358.879649:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788841358.879655:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788841358.879658:0:3648:0:(import.c:65:import_set_state_nolock()) ffffa04a47d02000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788841358.879682:0:3648:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788841358.879690:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fa07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875735413533696:0@lo:8:kworker.0 00010000:00080000:0.0:1788841358.879715:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa04b7fa05880 x1875735413534208/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788841383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788841358.879725:0:3648:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1788841358.879730:0:3648:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788841358.879734:0:3648:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788841358.879736:0:3648:0:(import.c:65:import_set_state_nolock()) ffffa04b7cea3800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788841358.879751:0:3648:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788841358.879754:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fa05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875735413534208:0@lo:8:kworker.0 00000004:00080000:0.0:1788841358.881466:0:22799:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:0.0:1788841358.881515:0:22799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7f88c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22799:1875735413535104:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788841358.881584:0:22799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841358.884885:0:22799:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04a4789a600 going to sleep for 11 seconds 00000004:00080000:0.0:1788841358.884915:0:22798:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788841358.884928:0:23517:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788841358.884963:0:23517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b581a4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23517:1875735413535360:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1788841358.885022:0:22798:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 793079188335ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788841358.885029:0:22798:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788841358.885037:0:23517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841358.885066:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413535104 00000100:00100000:1.0:1788841358.885068:0:23517:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b6e077c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788841358.885075:0:24278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413535104 00000004:00080000:1.0:1788841358.885079:0:23516:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1788841358.885129:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413535360 00000100:00100000:0.0:1788841358.885133:0:24278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413535360 00000100:00100000:0.0:1788841358.885160:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788841358.885169:0:24278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7f88f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22799:x1875735413535104:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788841358.886737:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788841358.886753:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b581a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23517:x1875735413535360:12345-0@lo:7:osp-pre-1-1.0 00000100:00080000:0.0:1788841358.886899:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788841358.887027:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fa05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875735413533440:0@lo:400:kworker.0 00000100:00100000:0.0:1788841358.887042:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fa06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875735413534080:0@lo:400:kworker.0 00000004:00080000:1.0:1788841358.887593:0:23516:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 793081758089ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788841358.887607:0:23516:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788841358.887777:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fa07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875735413533568:0@lo:400:kworker.0 00010000:00080000:1.0:1788841358.887796:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa04b7fa04a80 x1875735413534336/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788841358.887808:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fa04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875735413534336:0@lo:400:kworker.0 00010000:00080000:1.0:1788841358.887826:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa04b7fa05f80 x1875735413534848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788841358.888280:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fa05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1875735413534848:0@lo:400:kworker.0 00000100:00100000:1.0:1788841358.888817:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7f88e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875735413534976:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788841358.888916:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788841358.888965:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa04b7fa04e00 x1875735413533824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788841358.888975:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fa04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875735413533824:0@lo:400:kworker.0 00010000:00080000:1.0:1788841358.888989:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa04b7fa06d80 x1875735413534464/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788841358.888997:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fa06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1875735413534464:0@lo:400:kworker.0 00000100:00100000:1.0:1788841358.889016:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788841358.889023:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b581a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875735413535232:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788841358.889047:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841358.889083:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413534976 00000100:00100000:1.0:1788841358.889089:0:24280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413534976 00000100:00100000:1.0:1788841358.889209:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413535232 00000100:00100000:1.0:1788841358.889213:0:24280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413535232 00000100:00100000:1.0:1788841358.889232:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788841358.889239:0:24280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b581a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3651:x1875735413534976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788841358.889268:0:24280:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788841358.889543:0:24280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b581a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3651:x1875735413534976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 302us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841358.889551:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788841358.889568:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788841358.889575:0:24280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b581a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3651:x1875735413535232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788841358.889585:0:24280:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788841358.889608:0:24280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b581a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3651:x1875735413535232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 35us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841358.889621:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788841358.889652:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa04b581a5f80 x1875735413535232/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841374 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788841358.889679:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b581a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875735413535232:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1788841358.889692:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa04b7f88e680 x1875735413534976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788841374 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788841358.889703:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7f88e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875735413534976:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788841358.889879:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fa04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875735413533952:0@lo:400:kworker.0 00010000:00080000:1.0:1788841358.889895:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa04b7fa05180 x1875735413534592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788841358.889905:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fa05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1875735413534592:0@lo:400:kworker.0 00000004:00080000:1.0:1788841358.890759:0:23506:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:1.0:1788841358.891258:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413534720 00000100:00100000:1.0:1788841358.891265:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413534720 00000100:00100000:1.0:1788841358.891332:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788841358.891341:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7f88e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875735413534720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841358.891506:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7f88e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875735413534720:12345-0@lo:400:kworker.0 Request processed in 165us (12843us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841358.891513:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1788841358.891912:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788841358.891952:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa04b7fa04700 x1875735413534720/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841358.891968:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fa04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1875735413534720:0@lo:400:kworker.0 00002000:00080000:0.0:1788841358.893820:0:24278:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1788841358.893853:0:24278:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:0.0:1788841358.893862:0:24278:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00002000:00080000:1.0:1788841358.898443:0:24277:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1788841358.898453:0:24277:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1788841358.898562:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b581a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23517:x1875735413535360:12345-0@lo:7:osp-pre-1-1.0 Request processed in 11809us (13519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841358.898574:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1788841358.898807:0:23517:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa04b581a4a80 x1875735413535360/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788841374 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841358.898825:0:23517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b581a4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23517:1875735413535360:0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1788841358.898856:0:23517:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1788841358.898907:0:23517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47cbce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23517:1875735413535488:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1788841358.898949:0:23517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841358.898988:0:23517:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b48911240 going to sleep for 11 seconds 00000100:00100000:1.0:1788841358.899000:0:24716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413535488 00000100:00100000:1.0:1788841358.899009:0:24716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413535488 00000100:00100000:1.0:1788841358.899064:0:24716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788841358.899072:0:24716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7fb86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23517:x1875735413535488:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1788841358.899112:0:24716:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1788841358.900058:0:24716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7fb86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23517:x1875735413535488:12345-0@lo:5:osp-pre-1-1.0 Request processed in 982us (1104us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841358.900138:0:24716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1788841358.900728:0:23517:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa04a47cbce00 x1875735413535488/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788841374 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841358.900744:0:23517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47cbce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23517:1875735413535488:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1788841358.900757:0:23517:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1788841358.900802:0:23517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b81b21880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23517:1875735413535616:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1788841358.900858:0:23517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841358.900885:0:23517:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b7ddb09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788841358.900903:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413535616 00000100:00100000:3.0:1788841358.900908:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413535616 00000100:00100000:3.0:1788841358.900944:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788841358.900953:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b81b23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23517:x1875735413535616:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1788841358.900989:0:24277:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00000004:00080000:3.0:1788841358.907068:0:22752:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:0.0:1788841358.907693:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788841358.907703:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000526c6333/0x5757cd208ac384b1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.907722:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=793s v=(0 0) 00010000:00010000:0.0:1788841358.907727:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788841358.907734:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000526c6333/0x5757cd208ac384b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.907757:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000526c6333/0x5757cd208ac384b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.907770:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000526c6333/0x5757cd208ac384b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.907778:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000526c6333/0x5757cd208ac384b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.907795:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788841358.907813:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788841358.907819:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000526c6333/0x5757cd208ac384b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.907827:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a47cac000 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:0.0:1788841358.907874:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000526c6333/0x5757cd208ac384b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.907884:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000526c6333/0x5757cd208ac384b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.907902:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000526c6333/0x5757cd208ac384b1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.907908:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000526c6333/0x5757cd208ac384b1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.907929:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841358.907930:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841358.907932:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788841358.908392:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788841358.908400:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000536af1e8/0x5757cd208ac384b8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.908408:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=793s v=(0 0) 00010000:00010000:0.0:1788841358.908412:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788841358.908416:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000536af1e8/0x5757cd208ac384b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.908437:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000536af1e8/0x5757cd208ac384b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.908446:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000536af1e8/0x5757cd208ac384b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.908452:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000536af1e8/0x5757cd208ac384b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.908469:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788841358.908528:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788841358.908534:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000536af1e8/0x5757cd208ac384b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841358.908543:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a47cadc00 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:3.0:1788841358.908546:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000536af1e8/0x5757cd208ac384b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841358.908554:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000536af1e8/0x5757cd208ac384b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841358.908568:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000536af1e8/0x5757cd208ac384b8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841358.908575:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000536af1e8/0x5757cd208ac384b8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841358.908590:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841358.908592:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841358.908593:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788841358.908915:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788841358.908921:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4b31b5b/0x5757cd208ac384bf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.908930:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=793s v=(0 0) 00010000:00010000:0.0:1788841358.908933:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788841358.908937:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4b31b5b/0x5757cd208ac384bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.908946:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4b31b5b/0x5757cd208ac384bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.908953:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4b31b5b/0x5757cd208ac384bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.908972:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a4b31b5b/0x5757cd208ac384bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.908992:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788841358.909000:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788841358.909004:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a4b31b5b/0x5757cd208ac384bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.909011:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a47cac200 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:0.0:1788841358.909014:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4b31b5b/0x5757cd208ac384bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.909022:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4b31b5b/0x5757cd208ac384bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.909032:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a4b31b5b/0x5757cd208ac384bf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.909039:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4b31b5b/0x5757cd208ac384bf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.909051:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841358.909053:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841358.909055:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788841358.909534:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788841358.909547:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035bf3b9f/0x5757cd208ac384c6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.909555:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=793s v=(0 0) 00010000:00010000:0.0:1788841358.909559:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788841358.909563:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035bf3b9f/0x5757cd208ac384c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.909571:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035bf3b9f/0x5757cd208ac384c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.909579:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035bf3b9f/0x5757cd208ac384c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.909586:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035bf3b9f/0x5757cd208ac384c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.909608:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788841358.909940:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788841358.909945:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c4944e2/0x5757cd208ac384cd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.909954:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=793s v=(0 0) 00010000:00010000:0.0:1788841358.909957:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788841358.909962:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c4944e2/0x5757cd208ac384cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.909971:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c4944e2/0x5757cd208ac384cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.909986:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c4944e2/0x5757cd208ac384cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.909993:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c4944e2/0x5757cd208ac384cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.910006:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788841358.910870:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788841358.910880:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035bf3b9f/0x5757cd208ac384c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.910891:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a47caca00 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:0.0:1788841358.910896:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035bf3b9f/0x5757cd208ac384c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.910906:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035bf3b9f/0x5757cd208ac384c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.910922:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035bf3b9f/0x5757cd208ac384c6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.910930:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035bf3b9f/0x5757cd208ac384c6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.910948:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788841358.910963:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c4944e2/0x5757cd208ac384cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.910970:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a47cac800 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:0.0:1788841358.910974:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c4944e2/0x5757cd208ac384cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.910982:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c4944e2/0x5757cd208ac384cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.910992:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c4944e2/0x5757cd208ac384cd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.910999:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c4944e2/0x5757cd208ac384cd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.911013:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841358.911015:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841358.911016:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841358.911252:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788841358.912740:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788841358.912750:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024db88f4/0x5757cd208ac384d4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.912768:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=793s v=(0 0) 00010000:00010000:0.0:1788841358.912773:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788841358.912780:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024db88f4/0x5757cd208ac384d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.912806:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024db88f4/0x5757cd208ac384d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.912816:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024db88f4/0x5757cd208ac384d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.912825:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024db88f4/0x5757cd208ac384d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.912873:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788841358.913043:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788841358.913051:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024db88f4/0x5757cd208ac384d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841358.913060:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a47cad000 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:3.0:1788841358.913065:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024db88f4/0x5757cd208ac384d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841358.913082:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024db88f4/0x5757cd208ac384d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841358.913099:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024db88f4/0x5757cd208ac384d4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841358.913107:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024db88f4/0x5757cd208ac384d4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841358.913140:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841358.913142:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841358.913145:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788841358.913984:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788841358.913994:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0abc2e6/0x5757cd208ac384db lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841358.914007:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=793s v=(0 0) 00010000:00010000:3.0:1788841358.914011:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788841358.914017:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0abc2e6/0x5757cd208ac384db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841358.914028:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0abc2e6/0x5757cd208ac384db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841358.914037:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0abc2e6/0x5757cd208ac384db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841358.914051:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0abc2e6/0x5757cd208ac384db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841358.914067:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788841358.914271:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788841358.914279:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0abc2e6/0x5757cd208ac384db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.914287:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b7a722000 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:0.0:1788841358.914291:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0abc2e6/0x5757cd208ac384db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.914299:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0abc2e6/0x5757cd208ac384db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.914314:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0abc2e6/0x5757cd208ac384db lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.914322:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0abc2e6/0x5757cd208ac384db lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.914343:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841358.914345:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841358.914347:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788841358.914949:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788841358.914957:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f9c9625/0x5757cd208ac384e2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841358.914968:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=793s v=(0 0) 00010000:00010000:3.0:1788841358.914973:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788841358.914979:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f9c9625/0x5757cd208ac384e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841358.914989:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f9c9625/0x5757cd208ac384e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841358.914997:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f9c9625/0x5757cd208ac384e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841358.915004:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f9c9625/0x5757cd208ac384e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841358.915023:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788841358.915171:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788841358.915177:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f9c9625/0x5757cd208ac384e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.915185:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b7a723c00 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:0.0:1788841358.915189:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f9c9625/0x5757cd208ac384e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.915199:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f9c9625/0x5757cd208ac384e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.915211:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f9c9625/0x5757cd208ac384e2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.915218:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f9c9625/0x5757cd208ac384e2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.915233:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841358.915234:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841358.915236:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788841358.915974:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788841358.915981:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea91f8e1/0x5757cd208ac384e9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841358.916001:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=793s v=(0 0) 00010000:00010000:3.0:1788841358.916005:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788841358.916010:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea91f8e1/0x5757cd208ac384e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841358.916021:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea91f8e1/0x5757cd208ac384e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841358.916030:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea91f8e1/0x5757cd208ac384e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841358.916038:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea91f8e1/0x5757cd208ac384e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841358.916061:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788841358.916310:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788841358.916319:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea91f8e1/0x5757cd208ac384e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.916337:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b7f8c5a00 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:0.0:1788841358.916341:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea91f8e1/0x5757cd208ac384e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.916350:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea91f8e1/0x5757cd208ac384e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.916377:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea91f8e1/0x5757cd208ac384e9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.916384:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea91f8e1/0x5757cd208ac384e9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.916398:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841358.916400:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841358.916401:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788841358.916933:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788841358.916940:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c4a498b/0x5757cd208ac384f0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841358.916949:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=793s v=(0 0) 00010000:00010000:3.0:1788841358.916952:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788841358.916958:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c4a498b/0x5757cd208ac384f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841358.916968:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c4a498b/0x5757cd208ac384f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841358.916989:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c4a498b/0x5757cd208ac384f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841358.916996:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c4a498b/0x5757cd208ac384f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841358.917013:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788841358.917305:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788841358.917311:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c4a498b/0x5757cd208ac384f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.917319:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b7f8c4000 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:0.0:1788841358.917323:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c4a498b/0x5757cd208ac384f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.917332:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c4a498b/0x5757cd208ac384f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.917354:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c4a498b/0x5757cd208ac384f0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.917375:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c4a498b/0x5757cd208ac384f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.917392:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841358.917394:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841358.917396:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788841358.918109:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788841358.918117:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c4944e2/0x5757cd208ac384f7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.918138:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=793s v=(0 0) 00010000:00010000:0.0:1788841358.918143:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788841358.918149:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c4944e2/0x5757cd208ac384f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.918159:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c4944e2/0x5757cd208ac384f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.918168:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c4944e2/0x5757cd208ac384f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.918175:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c4944e2/0x5757cd208ac384f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.918207:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788841358.918489:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788841358.918497:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c4944e2/0x5757cd208ac384f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841358.918506:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a47cac800 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:3.0:1788841358.918510:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c4944e2/0x5757cd208ac384f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841358.918518:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c4944e2/0x5757cd208ac384f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841358.918532:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c4944e2/0x5757cd208ac384f7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841358.918541:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c4944e2/0x5757cd208ac384f7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841358.918556:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841358.918564:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841358.918565:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788841358.918894:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788841358.918902:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035bf3b9f/0x5757cd208ac384fe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.918912:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=793s v=(0 0) 00010000:00010000:0.0:1788841358.918916:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788841358.918921:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035bf3b9f/0x5757cd208ac384fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.918930:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035bf3b9f/0x5757cd208ac384fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.918938:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035bf3b9f/0x5757cd208ac384fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.918946:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035bf3b9f/0x5757cd208ac384fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.918961:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788841358.918970:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788841358.918974:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035bf3b9f/0x5757cd208ac384fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.918981:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a47caca00 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:0.0:1788841358.918990:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035bf3b9f/0x5757cd208ac384fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.918998:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035bf3b9f/0x5757cd208ac384fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.919009:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035bf3b9f/0x5757cd208ac384fe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.919016:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035bf3b9f/0x5757cd208ac384fe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.919030:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841358.919031:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841358.919033:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788841358.923545:0:25093:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:0.0:1788841358.923577:0:25093:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788841358.923583:0:25093:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1788841358.923987:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b81b23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:23517:x1875735413535616:12345-0@lo:5:osp-pre-1-1.0 Request processed in 23029us (23122us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1788841358.923999:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00002000:00010000:3.0:1788841358.924135:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788841358.924145:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4ca3ff4/0x5757cd208ac38505 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841358.924163:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=793s v=(0 0) 00010000:00010000:3.0:1788841358.924168:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788841358.924177:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4ca3ff4/0x5757cd208ac38505 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841358.924194:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4ca3ff4/0x5757cd208ac38505 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841358.924206:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4ca3ff4/0x5757cd208ac38505 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841358.924214:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4ca3ff4/0x5757cd208ac38505 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841358.924246:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788841358.924703:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788841358.924711:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4ca3ff4/0x5757cd208ac38505 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.924719:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b7f8c5200 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:1.0:1788841358.924724:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4ca3ff4/0x5757cd208ac38505 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.924734:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4ca3ff4/0x5757cd208ac38505 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.924768:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4ca3ff4/0x5757cd208ac38505 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.924777:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4ca3ff4/0x5757cd208ac38505 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.924799:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841358.924801:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841358.924803:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788841358.925106:0:23517:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1788841358.925117:0:23517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b81b21880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23517:1875735413535616:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788841358.925201:0:23517:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:0.0:1788841358.925265:0:23517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7f88c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23517:1875735413535744:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1788841358.925321:0:23517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841358.925394:0:23517:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04a4789a780 going to sleep for 11 seconds 00000100:00100000:1.0:1788841358.925507:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413535744 00000100:00100000:1.0:1788841358.925515:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413535744 00000100:00100000:1.0:1788841358.925599:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788841358.925609:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7f88ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23517:x1875735413535744:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1788841358.925663:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7f88ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23517:x1875735413535744:12345-0@lo:900:osp-pre-1-1.0 Request processed in 56us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841358.925682:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788841358.925750:0:23517:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa04b7f88c380 x1875735413535744/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788841374 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788841358.925778:0:23517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7f88c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23517:1875735413535744:0@lo:900:osp-pre-1-1.0 00002000:00010000:0.0:1788841358.926313:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788841358.926322:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035bf3b9f/0x5757cd208ac3850c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.926337:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=793s v=(0 0) 00010000:00010000:0.0:1788841358.926342:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788841358.926348:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035bf3b9f/0x5757cd208ac3850c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.926434:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035bf3b9f/0x5757cd208ac3850c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.926446:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035bf3b9f/0x5757cd208ac3850c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.926454:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035bf3b9f/0x5757cd208ac3850c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.926471:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788841358.926484:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788841358.926490:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035bf3b9f/0x5757cd208ac3850c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.926497:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a47caca00 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:0.0:1788841358.926508:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035bf3b9f/0x5757cd208ac3850c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.926517:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035bf3b9f/0x5757cd208ac3850c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.926534:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035bf3b9f/0x5757cd208ac3850c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.926542:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035bf3b9f/0x5757cd208ac3850c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.926559:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841358.926560:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841358.926562:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788841358.927509:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788841358.927520:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4b31b5b/0x5757cd208ac38513 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.927533:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=793s v=(0 0) 00010000:00010000:0.0:1788841358.927537:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788841358.927542:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4b31b5b/0x5757cd208ac38513 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.927552:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4b31b5b/0x5757cd208ac38513 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.927561:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4b31b5b/0x5757cd208ac38513 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.927574:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a4b31b5b/0x5757cd208ac38513 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.927594:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788841358.927928:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788841358.927934:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000526c6333/0x5757cd208ac3851a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.927943:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=793s v=(0 0) 00010000:00010000:0.0:1788841358.927946:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788841358.927951:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000526c6333/0x5757cd208ac3851a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.927959:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000526c6333/0x5757cd208ac3851a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.927966:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000526c6333/0x5757cd208ac3851a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.927973:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000526c6333/0x5757cd208ac3851a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.927987:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788841358.927994:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788841358.928000:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a4b31b5b/0x5757cd208ac38513 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.928014:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a47cac200 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:0.0:1788841358.928018:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4b31b5b/0x5757cd208ac38513 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.928027:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4b31b5b/0x5757cd208ac38513 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.928042:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a4b31b5b/0x5757cd208ac38513 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.928049:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4b31b5b/0x5757cd208ac38513 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.928067:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788841358.928071:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000526c6333/0x5757cd208ac3851a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.928077:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a47cac000 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:0.0:1788841358.928079:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000526c6333/0x5757cd208ac3851a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.928086:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000526c6333/0x5757cd208ac3851a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.928096:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000526c6333/0x5757cd208ac3851a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.928109:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000526c6333/0x5757cd208ac3851a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.928228:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841358.928443:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841358.928446:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841358.928448:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788841358.928867:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788841358.928874:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000230b5c0f/0x5757cd208ac38521 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.928885:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=793s v=(0 0) 00010000:00010000:0.0:1788841358.928890:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788841358.928895:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000230b5c0f/0x5757cd208ac38521 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.928904:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000230b5c0f/0x5757cd208ac38521 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.928912:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000230b5c0f/0x5757cd208ac38521 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.928919:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000230b5c0f/0x5757cd208ac38521 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.928938:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788841358.929029:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788841358.929034:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000230b5c0f/0x5757cd208ac38521 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.929043:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a47cace00 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:1.0:1788841358.929046:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000230b5c0f/0x5757cd208ac38521 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.929055:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000230b5c0f/0x5757cd208ac38521 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.929069:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000230b5c0f/0x5757cd208ac38521 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.929075:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000230b5c0f/0x5757cd208ac38521 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.929089:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841358.929090:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841358.929098:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788841358.929855:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788841358.929872:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001496368/0x5757cd208ac38528 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.929884:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=793s v=(0 0) 00010000:00010000:0.0:1788841358.929889:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788841358.929894:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001496368/0x5757cd208ac38528 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.929906:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001496368/0x5757cd208ac38528 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.929915:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001496368/0x5757cd208ac38528 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.929923:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001496368/0x5757cd208ac38528 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.929939:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788841358.929949:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788841358.929953:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001496368/0x5757cd208ac38528 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.929961:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a47cada00 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:0.0:1788841358.929964:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001496368/0x5757cd208ac38528 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.929972:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001496368/0x5757cd208ac38528 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.929992:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001496368/0x5757cd208ac38528 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.930000:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001496368/0x5757cd208ac38528 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.930014:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841358.930016:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841358.930017:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788841358.930696:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788841358.930705:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0d96737/0x5757cd208ac3852f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.930715:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=793s v=(0 0) 00010000:00010000:0.0:1788841358.930719:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788841358.930724:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0d96737/0x5757cd208ac3852f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.930789:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0d96737/0x5757cd208ac3852f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.930800:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0d96737/0x5757cd208ac3852f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.930807:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0d96737/0x5757cd208ac3852f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.930862:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788841358.931110:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788841358.931117:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0d96737/0x5757cd208ac3852f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.931203:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a47cacc00 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:1.0:1788841358.931207:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0d96737/0x5757cd208ac3852f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.931215:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0d96737/0x5757cd208ac3852f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.931229:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0d96737/0x5757cd208ac3852f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.931236:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0d96737/0x5757cd208ac3852f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.931252:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841358.931254:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841358.931255:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788841358.931333:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788841358.931338:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006546d777/0x5757cd208ac38536 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.931347:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=793s v=(0 0) 00010000:00010000:0.0:1788841358.931350:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788841358.931355:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006546d777/0x5757cd208ac38536 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.931439:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006546d777/0x5757cd208ac38536 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.931448:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006546d777/0x5757cd208ac38536 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.931455:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006546d777/0x5757cd208ac38536 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.931476:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788841358.931719:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788841358.931724:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006546d777/0x5757cd208ac38536 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.931786:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a47cad200 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:1.0:1788841358.931792:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006546d777/0x5757cd208ac38536 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.931813:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006546d777/0x5757cd208ac38536 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.931824:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006546d777/0x5757cd208ac38536 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.931852:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006546d777/0x5757cd208ac38536 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.931868:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841358.931869:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841358.931871:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788841358.931971:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788841358.931977:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2f6218b/0x5757cd208ac3853d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.931986:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=793s v=(0 0) 00010000:00010000:0.0:1788841358.931996:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788841358.932001:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2f6218b/0x5757cd208ac3853d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.932011:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2f6218b/0x5757cd208ac3853d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.932018:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2f6218b/0x5757cd208ac3853d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.932025:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2f6218b/0x5757cd208ac3853d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.932071:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788841358.932479:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788841358.932485:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016d2a970/0x5757cd208ac38544 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.932495:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=793s v=(0 0) 00010000:00010000:0.0:1788841358.932498:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788841358.932502:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016d2a970/0x5757cd208ac38544 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.932512:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016d2a970/0x5757cd208ac38544 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.932520:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016d2a970/0x5757cd208ac38544 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.932533:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016d2a970/0x5757cd208ac38544 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.932627:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788841358.932633:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2f6218b/0x5757cd208ac3853d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.932641:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a47cade00 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:1.0:1788841358.932645:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2f6218b/0x5757cd208ac3853d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.932653:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2f6218b/0x5757cd208ac3853d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.932665:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2f6218b/0x5757cd208ac3853d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.932697:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2f6218b/0x5757cd208ac3853d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.932714:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788841358.932718:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016d2a970/0x5757cd208ac38544 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.932724:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a47cad800 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:1.0:1788841358.932726:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016d2a970/0x5757cd208ac38544 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.932733:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016d2a970/0x5757cd208ac38544 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.932755:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016d2a970/0x5757cd208ac38544 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.932764:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841358.932766:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841358.932768:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841358.932888:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788841358.932893:0:24278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016d2a970/0x5757cd208ac38544 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788841358.933210:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788841358.933217:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ddea84b/0x5757cd208ac3854b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.933225:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=793s v=(0 0) 00010000:00010000:0.0:1788841358.933229:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788841358.933233:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ddea84b/0x5757cd208ac3854b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.933242:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ddea84b/0x5757cd208ac3854b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.933250:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ddea84b/0x5757cd208ac3854b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.933257:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ddea84b/0x5757cd208ac3854b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.933438:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788841358.933443:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ddea84b/0x5757cd208ac3854b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.933450:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a47cad400 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:1.0:1788841358.933459:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ddea84b/0x5757cd208ac3854b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.933467:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ddea84b/0x5757cd208ac3854b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.933478:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ddea84b/0x5757cd208ac3854b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.933486:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841358.933488:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841358.933490:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841358.933566:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788841358.933567:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841358.933572:0:24278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ddea84b/0x5757cd208ac3854b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788841358.934344:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788841358.934352:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c4944e2/0x5757cd208ac38552 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.934434:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=793s v=(0 0) 00010000:00010000:0.0:1788841358.934443:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788841358.934449:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c4944e2/0x5757cd208ac38552 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.934460:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c4944e2/0x5757cd208ac38552 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.934472:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c4944e2/0x5757cd208ac38552 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.934480:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c4944e2/0x5757cd208ac38552 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.934494:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788841358.934548:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788841358.934554:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c4944e2/0x5757cd208ac38552 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.934562:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a47cac800 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:1.0:1788841358.934565:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c4944e2/0x5757cd208ac38552 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.934574:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c4944e2/0x5757cd208ac38552 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.934589:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c4944e2/0x5757cd208ac38552 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.934597:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c4944e2/0x5757cd208ac38552 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.934620:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841358.934622:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841358.934757:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788841358.934970:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788841358.934976:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024db88f4/0x5757cd208ac38559 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.934990:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=793s v=(0 0) 00010000:00010000:0.0:1788841358.934993:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788841358.934998:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024db88f4/0x5757cd208ac38559 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.935007:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024db88f4/0x5757cd208ac38559 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.935016:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024db88f4/0x5757cd208ac38559 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.935023:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024db88f4/0x5757cd208ac38559 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.935047:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788841358.935202:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788841358.935208:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024db88f4/0x5757cd208ac38559 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.935216:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a47cad000 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:1.0:1788841358.935219:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024db88f4/0x5757cd208ac38559 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.935227:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024db88f4/0x5757cd208ac38559 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.935239:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024db88f4/0x5757cd208ac38559 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.935246:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024db88f4/0x5757cd208ac38559 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.935262:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788841358.935590:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788841358.935597:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000536af1e8/0x5757cd208ac38560 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.935604:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=793s v=(0 0) 00010000:00010000:0.0:1788841358.935607:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788841358.935611:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000536af1e8/0x5757cd208ac38560 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.935619:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000536af1e8/0x5757cd208ac38560 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.935749:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841358.935753:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841358.936012:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000536af1e8/0x5757cd208ac38560 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.936018:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000536af1e8/0x5757cd208ac38560 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.936034:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788841358.936302:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788841358.936308:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000536af1e8/0x5757cd208ac38560 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.936326:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a47cadc00 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:1.0:1788841358.936330:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000536af1e8/0x5757cd208ac38560 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.936337:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000536af1e8/0x5757cd208ac38560 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.936351:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000536af1e8/0x5757cd208ac38560 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.936359:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000536af1e8/0x5757cd208ac38560 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.936379:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841358.936381:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841358.936383:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788841358.936809:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788841358.936911:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000199b3341/0x5757cd208ac38567 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.936923:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=793s v=(0 0) 00010000:00010000:0.0:1788841358.936926:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788841358.936933:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000199b3341/0x5757cd208ac38567 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.936943:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000199b3341/0x5757cd208ac38567 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.936951:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000199b3341/0x5757cd208ac38567 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.936959:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000199b3341/0x5757cd208ac38567 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.936985:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788841358.937118:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788841358.937124:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000199b3341/0x5757cd208ac38567 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.937132:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a47cad600 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:1.0:1788841358.937141:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000199b3341/0x5757cd208ac38567 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.937150:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000199b3341/0x5757cd208ac38567 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.937170:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000199b3341/0x5757cd208ac38567 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.937177:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000199b3341/0x5757cd208ac38567 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.937191:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841358.937192:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841358.937194:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788841358.937355:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788841358.937360:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035bf3b9f/0x5757cd208ac3856e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.937498:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=793s v=(0 0) 00010000:00010000:0.0:1788841358.937501:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788841358.937505:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035bf3b9f/0x5757cd208ac3856e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.937513:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035bf3b9f/0x5757cd208ac3856e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.937522:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035bf3b9f/0x5757cd208ac3856e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.937529:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035bf3b9f/0x5757cd208ac3856e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.937547:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788841358.937949:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788841358.937955:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f9c9625/0x5757cd208ac38575 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.937964:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=793s v=(0 0) 00010000:00010000:0.0:1788841358.937972:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788841358.937977:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f9c9625/0x5757cd208ac38575 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.937987:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f9c9625/0x5757cd208ac38575 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.937996:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f9c9625/0x5757cd208ac38575 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.938003:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f9c9625/0x5757cd208ac38575 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.938024:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788841358.938261:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788841358.938268:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035bf3b9f/0x5757cd208ac3856e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841358.938290:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a47caca00 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:3.0:1788841358.938294:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035bf3b9f/0x5757cd208ac3856e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841358.938302:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035bf3b9f/0x5757cd208ac3856e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841358.938317:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035bf3b9f/0x5757cd208ac3856e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841358.938323:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035bf3b9f/0x5757cd208ac3856e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841358.938339:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788841358.938342:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f9c9625/0x5757cd208ac38575 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841358.938348:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b7a723c00 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:3.0:1788841358.938351:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f9c9625/0x5757cd208ac38575 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841358.938358:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f9c9625/0x5757cd208ac38575 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841358.938366:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f9c9625/0x5757cd208ac38575 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841358.938378:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f9c9625/0x5757cd208ac38575 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841358.938392:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841358.938394:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841358.938396:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841358.938571:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788841358.938940:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788841358.938947:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0abc2e6/0x5757cd208ac3857c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.938958:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=793s v=(0 0) 00010000:00010000:0.0:1788841358.938962:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788841358.938967:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0abc2e6/0x5757cd208ac3857c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.938977:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0abc2e6/0x5757cd208ac3857c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.938985:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0abc2e6/0x5757cd208ac3857c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.938999:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0abc2e6/0x5757cd208ac3857c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.939011:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788841358.939768:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788841358.939776:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0abc2e6/0x5757cd208ac3857c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841358.939786:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b7a722000 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:3.0:1788841358.939791:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0abc2e6/0x5757cd208ac3857c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841358.939799:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0abc2e6/0x5757cd208ac3857c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841358.939814:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0abc2e6/0x5757cd208ac3857c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841358.939822:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0abc2e6/0x5757cd208ac3857c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841358.939859:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841358.939862:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841358.939864:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788841358.939951:0:24278:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788841358.939958:0:24278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001abdef8/0x5757cd208ac38583 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.939967:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=793s v=(0 0) 00010000:00010000:0.0:1788841358.939971:0:24278:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788841358.939977:0:24278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001abdef8/0x5757cd208ac38583 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.939987:0:24278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001abdef8/0x5757cd208ac38583 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.939995:0:24278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001abdef8/0x5757cd208ac38583 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.940001:0:24278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001abdef8/0x5757cd208ac38583 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841358.940025:0:24278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1788841358.940063:0:24278:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00010000:00010000:1.0:1788841358.940124:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788841358.940130:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001abdef8/0x5757cd208ac38583 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.940138:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a4750b600 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:1.0:1788841358.940141:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001abdef8/0x5757cd208ac38583 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.940149:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001abdef8/0x5757cd208ac38583 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.940160:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001abdef8/0x5757cd208ac38583 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.940167:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001abdef8/0x5757cd208ac38583 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841358.940194:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841358.940196:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788841358.940197:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788841358.940255:0:24278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7f88f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22799:x1875735413535104:12345-0@lo:5:osp-pre-1-0.0 Request processed in 55082us (58667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841358.940274:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788841358.940463:0:22799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7f88c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22799:1875735413535104:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788841358.940481:0:22799:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:1.0:1788841358.940535:0:22799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b581a5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22799:1875735413535872:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788841358.940576:0:22799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841358.940612:0:22799:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b6e0353c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788841358.941231:0:24716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413535872 00000100:00100000:0.0:1788841358.941240:0:24716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413535872 00000100:00100000:0.0:1788841358.941490:0:24716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788841358.941502:0:24716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b581a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22799:x1875735413535872:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788841358.941554:0:24716:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:0.0:1788841358.944596:0:24716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b581a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22799:x1875735413535872:12345-0@lo:5:osp-pre-1-0.0 Request processed in 3090us (4012us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1788841358.944609:0:24716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788841358.944645:0:22799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b581a5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22799:1875735413535872:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788841358.944684:0:22799:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00000040:00080000:2.0:1788841358.989661:0:22808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788841359.700733:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788841360.459989:0:25449:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg407-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788841360.722281:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788841361.422425:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7f88c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875735413536000:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788841361.422514:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841361.422561:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413536000 00000100:00100000:1.0:1788841361.422571:0:24280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413536000 00000100:00100000:1.0:1788841361.422662:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788841361.422674:0:24280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7f88f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875735413536000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788841361.422711:0:24280:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788841361.422769:0:24280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7f88f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875735413536000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841361.422777:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788841361.422829:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7f88c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875735413536000:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788841361.423017:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000004:2.0:1788841361.535449:0:25502:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788841361.536124:0:25502:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788841361.741975:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788841361.936347:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788841361.936451:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7f88ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875735413536128:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788841361.936545:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841361.936620:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7f88f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875735413536256:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788841361.936648:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841361.936690:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413536128 00000100:00100000:0.0:1788841361.936701:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413536128 00000100:00100000:0.0:1788841361.936757:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413536256 00000100:00100000:0.0:1788841361.936760:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413536256 00000100:00100000:0.0:1788841361.936779:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788841361.936790:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7f88fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875735413536128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788841361.936870:0:22778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788841361.936926:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7f88fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875735413536128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 137us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841361.936953:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788841361.936975:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788841361.936981:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7f88d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875735413536256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788841361.937001:0:22778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788841361.937032:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7f88d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875735413536256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 52us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841361.937039:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788841361.938533:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7f88ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875735413536128:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788841361.938605:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7f88f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875735413536256:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788841362.445042:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788841362.445072:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b81b20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875735413536384:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788841362.445169:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841362.445265:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413536384 00000100:00100000:1.0:1788841362.445287:0:24280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413536384 00000100:00100000:1.0:1788841362.445373:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788841362.445406:0:24280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b81b20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875735413536384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788841362.445431:0:24280:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788841362.445487:0:24280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b81b20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875735413536384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841362.445495:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788841362.445544:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b81b20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875735413536384:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788841362.446086:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000004:2.0:1788841362.561748:0:25552:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788841362.562015:0:25552:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788841362.764931:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841362.860356:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:0.0:1788841362.860588:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392441472 00000100:00100000:0.0:1788841362.860611:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392441472 00000100:00100000:0.0:1788841362.860669:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 117 00000100:00100000:0.0:1788841362.860687:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47ee6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2399:x1875735392441472:12345-192.168.204.7@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788841362.860723:0:22767:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 25ddc60b-4cfa-4441-9231-3253d5543004@192.168.204.7@tcp t0 exp 0000000000000000 cur 797 last 0 00000020:00000080:0.0:1788841362.860765:0:22767:0:(genops.c:1385:class_connect()) connect: client 25ddc60b-4cfa-4441-9231-3253d5543004, cookie 0x5757cd208ac3858a 00000100:00080000:0.0:1788841362.860952:0:22767:0:(import.c:65:import_set_state_nolock()) ffffa04a47e02000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788841362.861042:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47ee6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25ddc60b-4cfa-4441-9231-3253d5543004+5:2399:x1875735392441472:12345-192.168.204.7@tcp:250:mount.lustre.0 Request processed in 363us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841362.861051:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 117 00000100:00100000:3.0:1788841362.879242:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:0.0:1788841362.879441:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392441600 00000100:00100000:0.0:1788841362.879451:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392441600 00000100:00100000:0.0:1788841362.879523:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 118 00000100:00100000:0.0:1788841362.879534:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47ee4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25ddc60b-4cfa-4441-9231-3253d5543004+5:18145:x1875735392441600:12345-192.168.204.7@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788841362.879551:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841362.879584:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa04a4750a800/0x5757cd208ac38591 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x56167be89bd53a20 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841362.879641:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa04a4750a800/0x5757cd208ac38591 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53a20 expref: 6 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841362.879655:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa04a4750a800/0x5757cd208ac38591 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53a20 expref: 6 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841362.879673:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04a4750a800, rc 0) 00000100:00100000:0.0:1788841362.879748:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47ee4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25ddc60b-4cfa-4441-9231-3253d5543004+6:18145:x1875735392441600:12345-192.168.204.7@tcp:101:mount.lustre.0 Request processed in 216us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841362.879756:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 118 00000100:00100000:3.0:1788841362.888954:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:2.0:1788841362.889161:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392441728 00000100:00100000:2.0:1788841362.889171:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392441728 00000100:00100000:2.0:1788841362.889241:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 119 00000100:00100000:2.0:1788841362.889252:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47ee6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25ddc60b-4cfa-4441-9231-3253d5543004+6:18145:x1875735392441728:12345-192.168.204.7@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788841362.889381:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47ee6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25ddc60b-4cfa-4441-9231-3253d5543004+6:18145:x1875735392441728:12345-192.168.204.7@tcp:501:mount.lustre.0 Request processed in 130us (439us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788841362.889390:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 119 00000100:00100000:1.0:1788841362.896799:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:3.0:1788841362.897749:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392441856 00000100:00100000:3.0:1788841362.897761:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392441856 00000100:00100000:3.0:1788841362.897917:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 120 00000100:00100000:3.0:1788841362.897929:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47ee5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25ddc60b-4cfa-4441-9231-3253d5543004+6:18145:x1875735392441856:12345-192.168.204.7@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788841362.897948:0:22767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788841362.897967:0:22767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa04b7f8c5600/0x5757cd208ac38598 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x56167be89bd53a27 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841362.898002:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa04b7f8c5600/0x5757cd208ac38598 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53a27 expref: 7 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841362.898014:0:22767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa04b7f8c5600/0x5757cd208ac38598 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53a27 expref: 7 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841362.898024:0:22767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04b7f8c5600, rc 0) 00000100:00100000:3.0:1788841362.898108:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47ee5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25ddc60b-4cfa-4441-9231-3253d5543004+7:18145:x1875735392441856:12345-192.168.204.7@tcp:101:mount.lustre.0 Request processed in 181us (1320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841362.898115:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 120 00000100:00100000:3.0:1788841362.909202:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:0.0:1788841362.909304:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392441984 00000100:00100000:0.0:1788841362.909315:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392441984 00000100:00100000:0.0:1788841362.909374:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 121 00000100:00100000:0.0:1788841362.909385:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47ee5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25ddc60b-4cfa-4441-9231-3253d5543004+7:18145:x1875735392441984:12345-192.168.204.7@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788841362.909562:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47ee5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25ddc60b-4cfa-4441-9231-3253d5543004+8:18145:x1875735392441984:12345-192.168.204.7@tcp:501:mount.lustre.0 Request processed in 179us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841362.909571:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 121 00000100:00100000:1.0:1788841362.915533:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:3.0:1788841362.915708:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392442112 00000100:00100000:3.0:1788841362.915719:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392442112 00000100:00100000:3.0:1788841362.915778:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 122 00000100:00100000:3.0:1788841362.915804:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47ee7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25ddc60b-4cfa-4441-9231-3253d5543004+8:18145:x1875735392442112:12345-192.168.204.7@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788841362.915980:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47ee7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25ddc60b-4cfa-4441-9231-3253d5543004+8:18145:x1875735392442112:12345-192.168.204.7@tcp:503:mount.lustre.0 Request processed in 178us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841362.915988:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 122 00000100:00100000:1.0:1788841362.920668:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:2.0:1788841362.920862:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392442240 00000100:00100000:2.0:1788841362.920874:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392442240 00000100:00100000:2.0:1788841362.920934:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 123 00000100:00100000:2.0:1788841362.920945:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47ee6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25ddc60b-4cfa-4441-9231-3253d5543004+8:18164:x1875735392442240:12345-192.168.204.7@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788841362.921123:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47ee6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25ddc60b-4cfa-4441-9231-3253d5543004+8:18164:x1875735392442240:12345-192.168.204.7@tcp:502:llog_process_th.0 Request processed in 179us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841362.921131:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 123 00000100:00100000:1.0:1788841362.973399:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:0.0:1788841362.973480:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392442368 00000100:00100000:0.0:1788841362.973491:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392442368 00000100:00100000:0.0:1788841362.973551:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 124 00000100:00100000:0.0:1788841362.973562:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47ee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25ddc60b-4cfa-4441-9231-3253d5543004+8:18164:x1875735392442368:12345-192.168.204.7@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788841362.973913:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47ee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25ddc60b-4cfa-4441-9231-3253d5543004+8:18164:x1875735392442368:12345-192.168.204.7@tcp:502:llog_process_th.0 Request processed in 351us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841362.973921:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 124 00000100:00100000:1.0:1788841362.990623:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:3.0:1788841362.991037:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392442496 00000100:00100000:3.0:1788841362.991048:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392442496 00000100:00100000:3.0:1788841362.991119:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 125 00000100:00100000:3.0:1788841362.991129:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47ee4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25ddc60b-4cfa-4441-9231-3253d5543004+8:18164:x1875735392442496:12345-192.168.204.7@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788841362.991301:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47ee4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25ddc60b-4cfa-4441-9231-3253d5543004+8:18164:x1875735392442496:12345-192.168.204.7@tcp:502:llog_process_th.0 Request processed in 172us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841362.991310:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 125 00000100:00100000:1.0:1788841363.000723:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:0.0:1788841363.000950:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392442624 00000100:00100000:0.0:1788841363.000961:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392442624 00000100:00100000:0.0:1788841363.001023:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 126 00000100:00100000:0.0:1788841363.001034:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47ee5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25ddc60b-4cfa-4441-9231-3253d5543004+8:18145:x1875735392442624:12345-192.168.204.7@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788841363.001052:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841363.001080:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa04a4750ae00/0x5757cd208ac3859f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x56167be89bd53a58 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841363.001111:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa04a4750ae00/0x5757cd208ac3859f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53a58 expref: 9 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841363.001122:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa04a4750ae00/0x5757cd208ac3859f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53a58 expref: 9 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841363.001131:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04a4750ae00, rc 0) 00000100:00100000:0.0:1788841363.001200:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47ee5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25ddc60b-4cfa-4441-9231-3253d5543004+9:18145:x1875735392442624:12345-192.168.204.7@tcp:101:mount.lustre.0 Request processed in 168us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841363.001207:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 126 00000100:00100000:0.0:1788841363.009869:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:2.0:1788841363.009972:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392442752 00000100:00100000:2.0:1788841363.009986:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392442752 00000100:00100000:2.0:1788841363.010047:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 127 00000100:00100000:2.0:1788841363.010058:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b4765f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25ddc60b-4cfa-4441-9231-3253d5543004+9:18145:x1875735392442752:12345-192.168.204.7@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788841363.010084:0:22764:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788841363.010110:0:22764:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788841363.010114:0:22764:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788841363.010117:0:22764:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788841363.010120:0:22764:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788841363.010123:0:22764:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:2.0:1788841363.011603:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b4765f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25ddc60b-4cfa-4441-9231-3253d5543004+9:18145:x1875735392442752:12345-192.168.204.7@tcp:256:mount.lustre.0 Request processed in 1528us (1759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841363.011626:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 127 00000100:00100000:1.0:1788841363.022028:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:3.0:1788841363.022195:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392442880 00000100:00100000:3.0:1788841363.022207:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392442880 00000100:00100000:3.0:1788841363.022263:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 128 00000100:00100000:3.0:1788841363.022274:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b67a3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25ddc60b-4cfa-4441-9231-3253d5543004+9:18145:x1875735392442880:12345-192.168.204.7@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788841363.022296:0:22767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788841363.022315:0:22767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa04b7f8c5800/0x5757cd208ac385a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x56167be89bd53a5f expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841363.022345:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa04b7f8c5800/0x5757cd208ac385a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53a5f expref: 10 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841363.022357:0:22767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa04b7f8c5800/0x5757cd208ac385a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53a5f expref: 10 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841363.022367:0:22767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04b7f8c5800, rc 0) 00000100:00100000:3.0:1788841363.022442:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b67a3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25ddc60b-4cfa-4441-9231-3253d5543004+10:18145:x1875735392442880:12345-192.168.204.7@tcp:101:mount.lustre.0 Request processed in 169us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841363.022449:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 128 00000100:00100000:0.0:1788841363.030017:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:2.0:1788841363.030121:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392443008 00000100:00100000:2.0:1788841363.030130:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392443008 00000100:00100000:2.0:1788841363.030221:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 129 00000100:00100000:2.0:1788841363.030232:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b67a38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25ddc60b-4cfa-4441-9231-3253d5543004+10:18145:x1875735392443008:12345-192.168.204.7@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788841363.030391:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b67a38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25ddc60b-4cfa-4441-9231-3253d5543004+10:18145:x1875735392443008:12345-192.168.204.7@tcp:501:mount.lustre.0 Request processed in 161us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841363.030399:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 129 00000100:00100000:1.0:1788841363.033044:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:0.0:1788841363.034471:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392443136 00000100:00100000:0.0:1788841363.034484:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392443136 00000100:00100000:0.0:1788841363.034621:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 130 00000100:00100000:0.0:1788841363.034633:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b67a3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25ddc60b-4cfa-4441-9231-3253d5543004+10:18145:x1875735392443136:12345-192.168.204.7@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788841363.034803:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b67a3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25ddc60b-4cfa-4441-9231-3253d5543004+10:18145:x1875735392443136:12345-192.168.204.7@tcp:503:mount.lustre.0 Request processed in 171us (1767us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841363.034820:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 130 00000100:00100000:1.0:1788841363.041201:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:2.0:1788841363.041368:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392443264 00000100:00100000:2.0:1788841363.041378:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392443264 00000100:00100000:2.0:1788841363.041433:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 131 00000100:00100000:2.0:1788841363.041444:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b67a38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25ddc60b-4cfa-4441-9231-3253d5543004+10:18171:x1875735392443264:12345-192.168.204.7@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788841363.041750:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b67a38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25ddc60b-4cfa-4441-9231-3253d5543004+10:18171:x1875735392443264:12345-192.168.204.7@tcp:502:llog_process_th.0 Request processed in 307us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841363.041759:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 131 00000100:00100000:1.0:1788841363.051156:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:0.0:1788841363.051261:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392443392 00000100:00100000:0.0:1788841363.051272:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392443392 00000100:00100000:0.0:1788841363.051384:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 132 00000100:00100000:0.0:1788841363.051394:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b67a39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25ddc60b-4cfa-4441-9231-3253d5543004+10:18171:x1875735392443392:12345-192.168.204.7@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788841363.051562:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b67a39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25ddc60b-4cfa-4441-9231-3253d5543004+10:18171:x1875735392443392:12345-192.168.204.7@tcp:502:llog_process_th.0 Request processed in 169us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841363.051569:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 132 00000100:00100000:1.0:1788841363.061229:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:1.0:1788841363.061335:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:0.0:1788841363.061563:0:25016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392443520 00000100:00100000:0.0:1788841363.061574:0:25016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392443520 00000100:00100000:2.0:1788841363.061605:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392443776 00000100:00100000:2.0:1788841363.061609:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392443776 00000100:00100000:0.0:1788841363.061638:0:25016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 7 00000100:00100000:0.0:1788841363.061647:0:25016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b581a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2399:x1875735392443520:12345-192.168.204.7@tcp:38:mount.lustre.0 00000100:00100000:2.0:1788841363.061736:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 8 00000100:00100000:2.0:1788841363.061742:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b581a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2399:x1875735392443776:12345-192.168.204.7@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788841363.061763:0:22774:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from fbb75a7f-409e-496d-8433-a98f63f91f81@192.168.204.7@tcp t0 exp 0000000000000000 cur 797 last 0 00000020:00000080:2.0:1788841363.061823:0:22774:0:(genops.c:1385:class_connect()) connect: client fbb75a7f-409e-496d-8433-a98f63f91f81, cookie 0x5757cd208ac385ad 00000004:00100000:2.0:1788841363.062000:0:22774:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00010000:00080000:0.0:1788841363.062069:0:25016:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from fbb75a7f-409e-496d-8433-a98f63f91f81@192.168.204.7@tcp t0 exp 0000000000000000 cur 797 last 0 00000020:00000080:0.0:1788841363.062112:0:25016:0:(genops.c:1385:class_connect()) connect: client fbb75a7f-409e-496d-8433-a98f63f91f81, cookie 0x5757cd208ac385b4 00000004:00100000:0.0:1788841363.062126:0:25016:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788841363.062223:0:22774:0:(import.c:65:import_set_state_nolock()) ffffa04b7d559800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1788841363.062320:0:25016:0:(import.c:65:import_set_state_nolock()) ffffa04a47e06800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788841363.062381:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b581a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fbb75a7f-409e-496d-8433-a98f63f91f81+6:2399:x1875735392443776:12345-192.168.204.7@tcp:38:mount.lustre.0 Request processed in 636us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841363.062381:0:25016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b581a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fbb75a7f-409e-496d-8433-a98f63f91f81+6:2399:x1875735392443520:12345-192.168.204.7@tcp:38:mount.lustre.0 Request processed in 732us (1160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841363.062390:0:25016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 7 00000100:00100000:2.0:1788841363.062401:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 8 00000100:00100000:1.0:1788841363.069125:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:1.0:1788841363.069209:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:3.0:1788841363.069637:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392443904 00000100:00100000:3.0:1788841363.069649:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392443904 00000100:00100000:3.0:1788841363.069821:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392443648 00000100:00100000:3.0:1788841363.069825:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392443648 00000100:00080000:1.0:1788841363.069899:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788841363.069904:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788841363.070016:0:25016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 9 00000100:00100000:0.0:1788841363.070030:0:25016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b581a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fbb75a7f-409e-496d-8433-a98f63f91f81+6:0:x1875735392443904:12345-192.168.204.7@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788841363.070072:0:25016:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788841363.070200:0:25016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b581a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fbb75a7f-409e-496d-8433-a98f63f91f81+6:0:x1875735392443904:12345-192.168.204.7@tcp:41:mount.lustre.0 Request processed in 173us (1088us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841363.070207:0:25016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 9 00000100:00100000:2.0:1788841363.070212:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 10 00000100:00100000:2.0:1788841363.070222:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b581a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fbb75a7f-409e-496d-8433-a98f63f91f81+6:0:x1875735392443648:12345-192.168.204.7@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788841363.070241:0:22774:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788841363.070282:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b581a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fbb75a7f-409e-496d-8433-a98f63f91f81+6:0:x1875735392443648:12345-192.168.204.7@tcp:41:mount.lustre.0 Request processed in 62us (1073us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841363.070288:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 10 00000100:00100000:3.0:1788841363.070766:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:0.0:1788841363.070949:0:25016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392444032 00000100:00100000:0.0:1788841363.070963:0:25016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392444032 00000100:00100000:0.0:1788841363.071004:0:25016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 11 00000100:00100000:0.0:1788841363.071012:0:25016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b81b23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fbb75a7f-409e-496d-8433-a98f63f91f81+6:18145:x1875735392444032:12345-192.168.204.7@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788841363.071027:0:25016:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788841363.071062:0:25016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b81b23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fbb75a7f-409e-496d-8433-a98f63f91f81+6:18145:x1875735392444032:12345-192.168.204.7@tcp:41:mount.lustre.0 Request processed in 51us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841363.071070:0:25016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 11 00000100:00100000:1.0:1788841363.076187:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:3.0:1788841363.076863:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392444160 00000100:00100000:3.0:1788841363.076875:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392444160 00000100:00100000:3.0:1788841363.076950:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 12 00000100:00100000:3.0:1788841363.076959:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b581a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fbb75a7f-409e-496d-8433-a98f63f91f81+6:18145:x1875735392444160:12345-192.168.204.7@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788841363.077104:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b581a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fbb75a7f-409e-496d-8433-a98f63f91f81+6:18145:x1875735392444160:12345-192.168.204.7@tcp:40:mount.lustre.0 Request processed in 145us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841363.077112:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 12 00000100:00100000:1.0:1788841363.085901:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:1.0:1788841363.085940:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:1.0:1788841363.086023:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:3.0:1788841363.086242:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392444288 00000100:00100000:3.0:1788841363.086255:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392444288 00000100:00100000:3.0:1788841363.086298:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392444416 00000100:00100000:3.0:1788841363.086301:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392444416 00000100:00100000:3.0:1788841363.086318:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 22 00000100:00100000:3.0:1788841363.086327:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b581a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2399:x1875735392444288:12345-192.168.204.7@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788841363.086360:0:24277:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from fbb75a7f-409e-496d-8433-a98f63f91f81@192.168.204.7@tcp t0 exp 0000000000000000 cur 797 last 0 00000020:00000080:3.0:1788841363.086389:0:24277:0:(genops.c:1385:class_connect()) connect: client fbb75a7f-409e-496d-8433-a98f63f91f81, cookie 0x5757cd208ac385bb 00002000:00100000:3.0:1788841363.086401:0:24277:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fbb75a7f-409e-496d-8433-a98f63f91f81/ffffa04a47db7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113972 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788841363.086418:0:24277:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788841363.086614:0:24277:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788841363.086647:0:24277:0:(import.c:65:import_set_state_nolock()) ffffa04a47db2000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788841363.086735:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b581a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fbb75a7f-409e-496d-8433-a98f63f91f81+6:2399:x1875735392444288:12345-192.168.204.7@tcp:8:mount.lustre.0 Request processed in 408us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841363.086743:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 22 00000100:00100000:3.0:1788841363.086760:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 23 00000100:00100000:3.0:1788841363.086765:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7fa04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2399:x1875735392444416:12345-192.168.204.7@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788841363.086782:0:24277:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from fbb75a7f-409e-496d-8433-a98f63f91f81@192.168.204.7@tcp t0 exp 0000000000000000 cur 797 last 0 00000020:00000080:3.0:1788841363.086799:0:24277:0:(genops.c:1385:class_connect()) connect: client fbb75a7f-409e-496d-8433-a98f63f91f81, cookie 0x5757cd208ac385c2 00002000:00100000:3.0:1788841363.086804:0:24277:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli fbb75a7f-409e-496d-8433-a98f63f91f81/ffffa04a47db3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113972 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788841363.086815:0:24277:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788841363.086977:0:24277:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788841363.087015:0:24277:0:(import.c:65:import_set_state_nolock()) ffffa04a47db0000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788841363.087053:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7fa04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fbb75a7f-409e-496d-8433-a98f63f91f81+6:2399:x1875735392444416:12345-192.168.204.7@tcp:8:mount.lustre.0 Request processed in 286us (1030us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841363.087061:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 23 00000100:00100000:0.0:1788841363.087512:0:22784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392444544 00000100:00100000:0.0:1788841363.087520:0:22784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392444544 00000100:00100000:0.0:1788841363.087573:0:22784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 3 00000100:00100000:0.0:1788841363.087581:0:22784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b581a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:fbb75a7f-409e-496d-8433-a98f63f91f81+6:18145:x1875735392444544:12345-192.168.204.7@tcp:900:mount.lustre.0 00000100:00100000:0.0:1788841363.087639:0:22784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b581a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:fbb75a7f-409e-496d-8433-a98f63f91f81+6:18145:x1875735392444544:12345-192.168.204.7@tcp:900:mount.lustre.0 Request processed in 59us (1748us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841363.087646:0:22784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 3 00000100:00100000:1.0:1788841363.090744:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:3.0:1788841363.090903:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392444672 00000100:00100000:3.0:1788841363.090913:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392444672 00000100:00100000:3.0:1788841363.090956:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 0 00000100:00100000:3.0:1788841363.090967:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7fa05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fbb75a7f-409e-496d-8433-a98f63f91f81+6:18145:x1875735392444672:12345-192.168.204.7@tcp:33:mount.lustre.0 00000004:00080000:3.0:1788841363.092961:0:22775:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1906us 00000004:00200000:1.0:1788841363.111882:0:22775:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788841363.112026:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7fa05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fbb75a7f-409e-496d-8433-a98f63f91f81+6:18145:x1875735392444672:12345-192.168.204.7@tcp:33:mount.lustre.0 Request processed in 21056us (21295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841363.112042:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 0 00000100:00100000:3.0:1788841363.268629:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:0.0:1788841363.268935:0:25016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392444800 00000100:00100000:0.0:1788841363.268952:0:25016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392444800 00000100:00100000:0.0:1788841363.269039:0:25016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 13 00000100:00100000:0.0:1788841363.269054:0:25016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b81b22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fbb75a7f-409e-496d-8433-a98f63f91f81+6:18194:x1875735392444800:12345-192.168.204.7@tcp:101:mkdir.0 00010000:00010000:0.0:1788841363.269088:0:25016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841363.269127:0:25016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750bc00/0x5757cd208ac385c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x56167be89bd53a90 expref: -99 pid: 25016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841363.269222:0:25016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750a400/0x5757cd208ac385d0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841363.269248:0:25016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750a400/0x5757cd208ac385d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841363.269300:0:25016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750a400/0x5757cd208ac385d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788841363.269381:0:25016:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788841363.269386:0:25016:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788841363.269436:0:25016:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750a400/0x5757cd208ac385d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841363.269471:0:25016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750bc00/0x5757cd208ac385c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53a90 expref: 8 pid: 25016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841363.270975:0:25016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750a400/0x5757cd208ac385d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53a90 expref: 7 pid: 25016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841363.270999:0:25016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa04b7f760c00) 00010000:00010000:0.0:1788841363.271003:0:25016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788841363.271008:0:25016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04a4750a400, rc 0) 00000100:00100000:2.0:1788841363.272325:0:25016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b81b22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fbb75a7f-409e-496d-8433-a98f63f91f81+7:18194:x1875735392444800:12345-192.168.204.7@tcp:101:mkdir.0 Request processed in 3262us (3699us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841363.272338:0:25016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 13 00000040:00080000:1.0:1788841363.726032:0:23525:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788841363.789116:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841363.981522:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fb84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875735413536640:0@lo:400:kworker.0 00000100:00100000:3.0:1788841363.981638:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841363.981756:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413536640 00000100:00100000:0.0:1788841363.981768:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413536640 00000100:00100000:0.0:1788841363.981856:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788841363.981868:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b81b22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875735413536640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841363.981937:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b81b22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875735413536640:12345-0@lo:400:kworker.0 Request processed in 72us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841363.981945:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788841363.982056:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fb86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875735413536768:0@lo:400:kworker.0 00000100:00100000:0.0:1788841363.982089:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841363.982120:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fb85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a456da20-a415-4617-896c-ee7aa5e4c089:3649:1875735413536512:0@lo:400:kworker.0 00000100:00100000:0.0:1788841363.982174:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841363.982210:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fb87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875735413536896:0@lo:400:kworker.0 00000100:00100000:0.0:1788841363.982238:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841363.983943:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fb84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875735413536640:0@lo:400:kworker.0 00000100:00100000:3.0:1788841363.983962:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7f84d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875735413537152:0@lo:400:kworker.0 00000100:00100000:1.0:1788841363.985290:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7f84d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875735413537408:0@lo:400:kworker.0 00000100:00100000:0.0:1788841363.987196:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413536768 00000100:00100000:0.0:1788841363.987213:0:24278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413536768 00000100:00100000:0.0:1788841363.987294:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413536896 00000100:00100000:0.0:1788841363.987299:0:24278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413536896 00000100:00100000:0.0:1788841363.987339:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788841363.987351:0:24278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7f88ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875735413536768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841363.988722:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841363.988747:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841363.988804:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7f84ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1875735413537664:0@lo:400:kworker.0 00000100:00100000:1.0:1788841363.988805:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7f84e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1875735413537920:0@lo:400:kworker.0 00000100:00100000:3.0:1788841363.988884:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841363.988955:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7f88f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875735413538176:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788841363.988989:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841363.989038:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413537664 00000100:00100000:2.0:1788841363.989040:0:24716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413537408 00000100:00100000:3.0:1788841363.989047:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413537664 00000100:00100000:2.0:1788841363.989048:0:24716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413537408 00000100:00100000:2.0:1788841363.989107:0:24716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788841363.989118:0:24716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7f88ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3652:x1875735413536896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841363.989176:0:24716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7f88ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3652:x1875735413536896:12345-0@lo:400:kworker.0 Request processed in 60us (6936us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841363.989183:0:24716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788841363.989202:0:24716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788841363.989209:0:24716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7fa06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1875735413537408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841363.989236:0:24716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7fa06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1875735413537408:12345-0@lo:400:kworker.0 Request processed in 28us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841363.989249:0:24716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788841363.989426:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7f84f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875735413537280:0@lo:400:kworker.0 00000100:00100000:2.0:1788841363.989457:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841363.989477:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7f84d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875735413537792:0@lo:400:kworker.0 00000100:00100000:2.0:1788841363.989498:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841363.989520:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fa04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875735413538304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788841363.989543:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841363.989583:0:24716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413537280 00000100:00100000:2.0:1788841363.989587:0:24716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413537280 00000100:00100000:2.0:1788841363.989613:0:24716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788841363.989619:0:24716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7f84df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875735413537280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841363.989654:0:24716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7f84df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875735413537280:12345-0@lo:400:kworker.0 Request processed in 36us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841363.989661:0:24716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788841363.989913:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7f84f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875735413537280:0@lo:400:kworker.0 00000100:00100000:2.0:1788841363.989947:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b491d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875735413537024:0@lo:400:kworker.0 00000100:00100000:2.0:1788841363.989976:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841363.989995:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7f84ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875735413537536:0@lo:400:kworker.0 00000100:00100000:3.0:1788841363.990077:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413537792 00000100:00100000:2.0:1788841363.990083:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841363.990099:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7f84c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1875735413538048:0@lo:400:kworker.0 00000100:00100000:2.0:1788841363.990129:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841363.990155:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413537024 00000100:00100000:2.0:1788841363.990160:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413537024 00000100:00100000:2.0:1788841363.990179:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413537536 00000100:00100000:2.0:1788841363.990191:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413537536 00000100:00100000:2.0:1788841363.990207:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413538048 00000100:00100000:2.0:1788841363.990209:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413538048 00000100:00100000:2.0:1788841363.990227:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788841363.990233:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b81b21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875735413537664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841363.990274:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b81b21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875735413537664:12345-0@lo:400:kworker.0 Request processed in 41us (1390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841363.990282:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788841363.990296:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788841363.990302:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7f84f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875735413537024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841363.990331:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7f84f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875735413537024:12345-0@lo:400:kworker.0 Request processed in 30us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841363.990338:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788841363.990349:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788841363.990488:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413537792 00000100:00100000:2.0:1788841363.990491:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7f84dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875735413537536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841363.990523:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788841363.990533:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7f84dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875735413537536:12345-0@lo:400:kworker.0 Request processed in 43us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841363.990535:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7f84c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875735413538048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841363.990548:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788841363.990565:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788841363.990585:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7f84e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875735413537792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841363.990599:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7f84c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875735413538048:12345-0@lo:400:kworker.0 Request processed in 67us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841363.990607:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788841363.990636:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413537152 00000100:00100000:3.0:1788841363.990642:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413537152 00000100:00100000:2.0:1788841363.990647:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7f84e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875735413537792:12345-0@lo:400:kworker.0 Request processed in 73us (1145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841363.990654:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788841363.990684:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788841363.990693:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b81b20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875735413537152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841363.990731:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b81b20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875735413537152:12345-0@lo:400:kworker.0 Request processed in 39us (2017us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841363.990737:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788841363.990777:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7f84d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875735413537152:0@lo:400:kworker.0 00000100:00100000:3.0:1788841363.990792:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7f84ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1875735413537664:0@lo:400:kworker.0 00000100:00100000:3.0:1788841363.990857:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413536512 00000100:00100000:3.0:1788841363.990861:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413536512 00010000:00080000:2.0:1788841363.990885:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa04b7f84d180 x1875735413537792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841363.990899:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7f84d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875735413537792:0@lo:400:kworker.0 00000100:00100000:2.0:1788841363.990938:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b491d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875735413537024:0@lo:400:kworker.0 00000100:00100000:2.0:1788841363.990951:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7f84ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875735413537536:0@lo:400:kworker.0 00000100:00100000:3.0:1788841363.990965:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788841363.990975:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b67a3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+24:3649:x1875735413536512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841363.990994:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841363.991032:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b67a3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+24:3649:x1875735413536512:12345-0@lo:400:kworker.0 Request processed in 59us (8856us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841363.991048:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fb87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875735413536896:0@lo:400:kworker.0 00000100:00100000:3.0:1788841363.991052:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788841363.991082:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7f84d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875735413537408:0@lo:400:kworker.0 00000100:00100000:1.0:1788841363.991120:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413538176 00000100:00100000:1.0:1788841363.991125:0:24280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413538176 00000100:00100000:1.0:1788841363.991148:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413538304 00000100:00100000:1.0:1788841363.991152:0:24280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413538304 00000100:00100000:1.0:1788841363.991169:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788841363.991178:0:24280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b81b23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875735413538176:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788841363.991193:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00002000:00000024:1.0:1788841363.991198:0:24280:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00080000:3.0:1788841363.991200:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788841363.991206:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788841363.991208:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788841363.991248:0:24280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b81b23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875735413538176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (2258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841363.991539:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788841363.991556:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788841363.991564:0:24280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7f84ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875735413538304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788841363.991586:0:24280:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788841363.991636:0:24280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7f84ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875735413538304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (2090us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841363.991650:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788841363.991674:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413537920 00000100:00100000:1.0:1788841363.991679:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413537920 00000100:00100000:0.0:1788841363.991684:0:24278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7f88ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875735413536768:12345-0@lo:400:kworker.0 Request processed in 4332us (9590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841363.991715:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788841363.991722:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7fa04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875735413537920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841363.991761:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7fa04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875735413537920:12345-0@lo:400:kworker.0 Request processed in 39us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841363.991769:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1788841363.991779:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa04b7f84c700 x1875735413538048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841363.991791:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7f84c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1875735413538048:0@lo:400:kworker.0 00000100:00100000:1.0:1788841363.991803:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7f84e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1875735413537920:0@lo:400:kworker.0 00000100:00080000:1.0:1788841363.991825:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788841363.991826:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fb85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a456da20-a415-4617-896c-ee7aa5e4c089:3649:1875735413536512:0@lo:400:kworker.0 00000100:00100000:0.0:1788841363.991911:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788841363.992041:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7f88f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875735413538176:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788841363.995529:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fa04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875735413538304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788841363.995559:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fb86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875735413536768:0@lo:400:kworker.0 00010000:00010000:2.0:1788841364.813095:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788841365.016738:0:25093:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fbb75a7f-409e-496d-8433-a98f63f91f81 00000001:00080000:0.0:1788841365.016761:0:25093:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000100:00100000:2.0:1788841365.304961:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:3.0:1788841365.305163:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392444928 00000100:00100000:3.0:1788841365.305176:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392444928 00000100:00080000:1.0:1788841365.305270:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788841365.305290:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 14 00000100:00100000:3.0:1788841365.305306:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7f84c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fbb75a7f-409e-496d-8433-a98f63f91f81+7:18247:x1875735392444928:12345-192.168.204.7@tcp:41:lfs.0 00000004:00000024:3.0:1788841365.305615:0:22772:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788841365.305751:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7f84c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fbb75a7f-409e-496d-8433-a98f63f91f81+7:18247:x1875735392444928:12345-192.168.204.7@tcp:41:lfs.0 Request processed in 448us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841365.305759:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 14 00000100:00100000:1.0:1788841365.316527:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:2.0:1788841365.316963:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392445056 00000100:00100000:2.0:1788841365.316977:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392445056 00000100:00100000:2.0:1788841365.317179:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 15 00000100:00100000:2.0:1788841365.317192:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7fa05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fbb75a7f-409e-496d-8433-a98f63f91f81+6:18247:x1875735392445056:12345-192.168.204.7@tcp:41:lfs.0 00000004:00000024:2.0:1788841365.317244:0:22773:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788841365.317371:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7fa05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fbb75a7f-409e-496d-8433-a98f63f91f81+6:18247:x1875735392445056:12345-192.168.204.7@tcp:41:lfs.0 Request processed in 181us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841365.317380:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 15 00000100:00080000:1.0:1788841365.320111:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788841365.320998:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:3.0:1788841365.321159:0:24282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392445184 00000100:00100000:3.0:1788841365.321173:0:24282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392445184 00000100:00100000:3.0:1788841365.321263:0:24282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 11 00000100:00100000:3.0:1788841365.321276:0:24282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7fa04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fbb75a7f-409e-496d-8433-a98f63f91f81+6:18247:x1875735392445184:12345-192.168.204.7@tcp:13:lfs.0 00002000:00000024:3.0:1788841365.321410:0:24282:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788841365.321537:0:24282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7fa04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fbb75a7f-409e-496d-8433-a98f63f91f81+6:18247:x1875735392445184:12345-192.168.204.7@tcp:13:lfs.0 Request processed in 264us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841365.321557:0:24282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 11 00000100:00080000:1.0:1788841365.321957:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788841365.328214:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:3.0:1788841365.328939:0:24282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392445312 00000100:00100000:3.0:1788841365.328955:0:24282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392445312 00000100:00100000:2.0:1788841365.329301:0:24282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 12 00000100:00100000:2.0:1788841365.329329:0:24282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7f88ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fbb75a7f-409e-496d-8433-a98f63f91f81+5:18247:x1875735392445312:12345-192.168.204.7@tcp:13:lfs.0 00002000:00000024:2.0:1788841365.329374:0:24282:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788841365.329488:0:24282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7f88ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fbb75a7f-409e-496d-8433-a98f63f91f81+5:18247:x1875735392445312:12345-192.168.204.7@tcp:13:lfs.0 Request processed in 176us (1289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841365.329496:0:24282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 12 00000100:00080000:1.0:1788841365.330971:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788841365.589274:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:0.0:1788841365.589438:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392445440 00000100:00100000:0.0:1788841365.589452:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392445440 00000100:00100000:0.0:1788841365.590220:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 134 00000100:00100000:0.0:1788841365.590238:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47cca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25ddc60b-4cfa-4441-9231-3253d5543004+10:18281:x1875735392445440:12345-192.168.204.7@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788841365.590262:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841365.590288:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa04a4750a600/0x5757cd208ac385d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x56167be89bd53a97 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841365.590331:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa04a4750a600/0x5757cd208ac385d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53a97 expref: 11 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841365.590345:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa04a4750a600/0x5757cd208ac385d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53a97 expref: 11 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841365.590372:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04a4750a600, rc 0) 00000100:00100000:0.0:1788841365.590462:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47cca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25ddc60b-4cfa-4441-9231-3253d5543004+11:18281:x1875735392445440:12345-192.168.204.7@tcp:101:mount.lustre.0 Request processed in 230us (1205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841365.590470:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 134 00000100:00100000:3.0:1788841365.595760:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:2.0:1788841365.596096:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392445568 00000100:00100000:2.0:1788841365.596110:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392445568 00000100:00100000:2.0:1788841365.596183:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 135 00000100:00100000:2.0:1788841365.596195:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47ccac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25ddc60b-4cfa-4441-9231-3253d5543004+11:18281:x1875735392445568:12345-192.168.204.7@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788841365.596416:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47ccac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25ddc60b-4cfa-4441-9231-3253d5543004+11:18281:x1875735392445568:12345-192.168.204.7@tcp:501:mount.lustre.0 Request processed in 222us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841365.596433:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 135 00000100:00100000:2.0:1788841365.601974:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:0.0:1788841365.603588:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392445696 00000100:00100000:0.0:1788841365.603616:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392445696 00000100:00100000:0.0:1788841365.603709:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 136 00000100:00100000:0.0:1788841365.603722:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47cc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25ddc60b-4cfa-4441-9231-3253d5543004+11:18281:x1875735392445696:12345-192.168.204.7@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788841365.603992:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47cc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25ddc60b-4cfa-4441-9231-3253d5543004+11:18281:x1875735392445696:12345-192.168.204.7@tcp:503:mount.lustre.0 Request processed in 272us (2034us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841365.604002:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 136 00000100:00100000:1.0:1788841365.607510:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:3.0:1788841365.610211:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392445824 00000100:00100000:3.0:1788841365.610239:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392445824 00000100:00100000:3.0:1788841365.610344:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 137 00000100:00100000:3.0:1788841365.610358:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47cc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25ddc60b-4cfa-4441-9231-3253d5543004+11:18286:x1875735392445824:12345-192.168.204.7@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788841365.611283:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47cc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25ddc60b-4cfa-4441-9231-3253d5543004+11:18286:x1875735392445824:12345-192.168.204.7@tcp:502:llog_process_th.0 Request processed in 922us (3783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841365.611295:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 137 00000100:00100000:2.0:1788841365.643077:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:3.0:1788841365.653872:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392445952 00000100:00100000:3.0:1788841365.653901:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392445952 00000100:00100000:3.0:1788841365.654014:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 138 00000100:00100000:3.0:1788841365.654028:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47cc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25ddc60b-4cfa-4441-9231-3253d5543004+11:18286:x1875735392445952:12345-192.168.204.7@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788841365.654280:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47cc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25ddc60b-4cfa-4441-9231-3253d5543004+11:18286:x1875735392445952:12345-192.168.204.7@tcp:502:llog_process_th.0 Request processed in 254us (11218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841365.654289:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 138 00000100:00100000:2.0:1788841365.672618:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:0.0:1788841365.672887:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392446080 00000100:00100000:0.0:1788841365.672901:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392446080 00000100:00100000:0.0:1788841365.672988:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 139 00000100:00100000:0.0:1788841365.673002:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47cca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25ddc60b-4cfa-4441-9231-3253d5543004+11:18286:x1875735392446080:12345-192.168.204.7@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788841365.673257:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47cca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25ddc60b-4cfa-4441-9231-3253d5543004+11:18286:x1875735392446080:12345-192.168.204.7@tcp:502:llog_process_th.0 Request processed in 256us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841365.673266:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 139 00000100:00100000:1.0:1788841365.678596:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:0.0:1788841365.678761:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392446208 00000100:00100000:0.0:1788841365.678776:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392446208 00000100:00100000:0.0:1788841365.678890:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 140 00000100:00100000:0.0:1788841365.678906:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47ccb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25ddc60b-4cfa-4441-9231-3253d5543004+11:18281:x1875735392446208:12345-192.168.204.7@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788841365.678930:0:22767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841365.678960:0:22767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa04a4750a000/0x5757cd208ac385de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x56167be89bd53ac8 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841365.679028:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa04a4750a000/0x5757cd208ac385de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53ac8 expref: 12 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841365.679042:0:22767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa04a4750a000/0x5757cd208ac385de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53ac8 expref: 12 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841365.679054:0:22767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04a4750a000, rc 0) 00000100:00100000:0.0:1788841365.679175:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47ccb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25ddc60b-4cfa-4441-9231-3253d5543004+12:18281:x1875735392446208:12345-192.168.204.7@tcp:101:mount.lustre.0 Request processed in 273us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841365.679183:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 140 00000100:00100000:2.0:1788841365.683966:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:3.0:1788841365.684117:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392446336 00000100:00100000:3.0:1788841365.684133:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392446336 00000100:00100000:3.0:1788841365.684197:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 141 00000100:00100000:3.0:1788841365.684208:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47ccb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25ddc60b-4cfa-4441-9231-3253d5543004+12:18281:x1875735392446336:12345-192.168.204.7@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788841365.684243:0:22764:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788841365.684277:0:22764:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788841365.684282:0:22764:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788841365.684286:0:22764:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788841365.684289:0:22764:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788841365.684292:0:22764:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:3.0:1788841365.686629:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47ccb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25ddc60b-4cfa-4441-9231-3253d5543004+12:18281:x1875735392446336:12345-192.168.204.7@tcp:256:mount.lustre.0 Request processed in 2399us (2662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841365.686663:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 141 00000100:00100000:1.0:1788841365.690968:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:0.0:1788841365.691136:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392446464 00000100:00100000:0.0:1788841365.691150:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392446464 00000100:00100000:0.0:1788841365.691220:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 142 00000100:00100000:0.0:1788841365.691232:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47cc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25ddc60b-4cfa-4441-9231-3253d5543004+12:18281:x1875735392446464:12345-192.168.204.7@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788841365.691254:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841365.691279:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa04a4750a200/0x5757cd208ac385e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x56167be89bd53acf expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841365.691319:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa04a4750a200/0x5757cd208ac385e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53acf expref: 13 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841365.691334:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa04a4750a200/0x5757cd208ac385e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53acf expref: 13 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841365.691345:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04a4750a200, rc 0) 00000100:00100000:0.0:1788841365.691418:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47cc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25ddc60b-4cfa-4441-9231-3253d5543004+13:18281:x1875735392446464:12345-192.168.204.7@tcp:101:mount.lustre.0 Request processed in 188us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841365.691461:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 142 00000100:00100000:2.0:1788841365.695548:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:3.0:1788841365.695764:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392446592 00000100:00100000:3.0:1788841365.695778:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392446592 00000100:00100000:3.0:1788841365.695894:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 143 00000100:00100000:3.0:1788841365.695908:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47ccb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25ddc60b-4cfa-4441-9231-3253d5543004+13:18281:x1875735392446592:12345-192.168.204.7@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788841365.696126:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47ccb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25ddc60b-4cfa-4441-9231-3253d5543004+13:18281:x1875735392446592:12345-192.168.204.7@tcp:501:mount.lustre.0 Request processed in 221us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841365.696134:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 143 00000100:00100000:2.0:1788841365.699050:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:3.0:1788841365.699328:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392446720 00000100:00100000:3.0:1788841365.699344:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392446720 00000100:00100000:3.0:1788841365.699424:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 144 00000100:00100000:3.0:1788841365.699437:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47cc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25ddc60b-4cfa-4441-9231-3253d5543004+13:18281:x1875735392446720:12345-192.168.204.7@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788841365.699983:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47cc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25ddc60b-4cfa-4441-9231-3253d5543004+13:18281:x1875735392446720:12345-192.168.204.7@tcp:503:mount.lustre.0 Request processed in 546us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841365.699994:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 144 00000100:00100000:1.0:1788841365.703765:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:0.0:1788841365.703965:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392446848 00000100:00100000:0.0:1788841365.703980:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392446848 00000100:00100000:0.0:1788841365.704107:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 145 00000100:00100000:0.0:1788841365.704121:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47ccbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25ddc60b-4cfa-4441-9231-3253d5543004+13:18289:x1875735392446848:12345-192.168.204.7@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788841365.704338:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47ccbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25ddc60b-4cfa-4441-9231-3253d5543004+13:18289:x1875735392446848:12345-192.168.204.7@tcp:502:llog_process_th.0 Request processed in 219us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841365.704348:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 145 00000100:00100000:1.0:1788841365.709819:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:2.0:1788841365.709965:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392446976 00000100:00100000:2.0:1788841365.709978:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392446976 00000100:00100000:2.0:1788841365.710063:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 146 00000100:00100000:2.0:1788841365.710075:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47cc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25ddc60b-4cfa-4441-9231-3253d5543004+13:18289:x1875735392446976:12345-192.168.204.7@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788841365.710269:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47cc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25ddc60b-4cfa-4441-9231-3253d5543004+13:18289:x1875735392446976:12345-192.168.204.7@tcp:502:llog_process_th.0 Request processed in 195us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841365.710278:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 146 00000100:00100000:1.0:1788841365.735380:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:1.0:1788841365.735500:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:2.0:1788841365.735816:0:25016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392447104 00000100:00100000:2.0:1788841365.735876:0:25016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392447104 00000100:00100000:2.0:1788841365.735932:0:25016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392447360 00000100:00100000:2.0:1788841365.735935:0:25016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392447360 00000100:00100000:2.0:1788841365.735961:0:25016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 16 00000100:00100000:2.0:1788841365.735972:0:25016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7fa07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2399:x1875735392447104:12345-192.168.204.7@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788841365.736014:0:25016:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0@192.168.204.7@tcp t0 exp 0000000000000000 cur 799 last 0 00000020:00000080:2.0:1788841365.736085:0:25016:0:(genops.c:1385:class_connect()) connect: client d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0, cookie 0x5757cd208ac385ec 00000004:00100000:2.0:1788841365.736121:0:25016:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788841365.736246:0:25016:0:(import.c:65:import_set_state_nolock()) ffffa04b7d558000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788841365.736332:0:25016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7fa07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+6:2399:x1875735392447104:12345-192.168.204.7@tcp:38:mount.lustre.0 Request processed in 359us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841365.736340:0:25016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 16 00000100:00100000:2.0:1788841365.736361:0:25016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 17 00000100:00100000:2.0:1788841365.736366:0:25016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7fa06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2399:x1875735392447360:12345-192.168.204.7@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788841365.736382:0:25016:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0@192.168.204.7@tcp t0 exp 0000000000000000 cur 799 last 0 00000020:00000080:2.0:1788841365.736408:0:25016:0:(genops.c:1385:class_connect()) connect: client d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0, cookie 0x5757cd208ac385f3 00000004:00100000:2.0:1788841365.736422:0:25016:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788841365.736628:0:25016:0:(import.c:65:import_set_state_nolock()) ffffa04b7d55e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788841365.736653:0:25016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7fa06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+6:2399:x1875735392447360:12345-192.168.204.7@tcp:38:mount.lustre.0 Request processed in 286us (1153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841365.736660:0:25016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 17 00000100:00100000:1.0:1788841365.745465:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:1.0:1788841365.745591:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:1.0:1788841365.752945:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:0.0:1788841365.759399:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392447616 00000100:00100000:0.0:1788841365.759424:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392447616 00000100:00100000:0.0:1788841365.759676:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392447232 00000100:00100000:0.0:1788841365.759681:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392447232 00000100:00100000:0.0:1788841365.759721:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 18 00000100:00100000:0.0:1788841365.759734:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7fa05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+7:18281:x1875735392447616:12345-192.168.204.7@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788841365.759783:0:22774:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788841365.759916:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7fa05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+7:18281:x1875735392447616:12345-192.168.204.7@tcp:41:mount.lustre.0 Request processed in 184us (14480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841365.759925:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 18 00000100:00100000:0.0:1788841365.759953:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 19 00000100:00100000:0.0:1788841365.759960:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7fa05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+6:0:x1875735392447232:12345-192.168.204.7@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788841365.759972:0:22774:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788841365.759997:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7fa05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+6:0:x1875735392447232:12345-192.168.204.7@tcp:41:mount.lustre.0 Request processed in 37us (14406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841365.760003:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 19 00000100:00080000:3.0:1788841365.760302:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788841365.765818:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392447488 00000100:00100000:0.0:1788841365.765869:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392447488 00000100:00100000:0.0:1788841365.765980:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 20 00000100:00100000:0.0:1788841365.765991:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7fa07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+6:0:x1875735392447488:12345-192.168.204.7@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788841365.766035:0:22774:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788841365.766126:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7fa07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+6:0:x1875735392447488:12345-192.168.204.7@tcp:41:mount.lustre.0 Request processed in 137us (13200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841365.766133:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 20 00000100:00080000:1.0:1788841365.766985:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788841365.768306:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:0.0:1788841365.770021:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392447744 00000100:00100000:0.0:1788841365.770041:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392447744 00000100:00100000:0.0:1788841365.770146:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 21 00000100:00100000:0.0:1788841365.770160:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7fa05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+6:18281:x1875735392447744:12345-192.168.204.7@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788841365.770279:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7fa05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+6:18281:x1875735392447744:12345-192.168.204.7@tcp:40:mount.lustre.0 Request processed in 121us (1984us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841365.770287:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 21 00000100:00100000:3.0:1788841365.772510:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:3.0:1788841365.772582:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:3.0:1788841365.772611:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:2.0:1788841365.772625:0:24716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392447872 00000100:00100000:3.0:1788841365.772635:0:24279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392448000 00000100:00100000:3.0:1788841365.772637:0:24279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392448000 00000100:00100000:2.0:1788841365.772637:0:24716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392447872 00000100:00100000:3.0:1788841365.772772:0:24279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 24 00000100:00100000:3.0:1788841365.772782:0:24279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b81b20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2399:x1875735392447872:12345-192.168.204.7@tcp:8:mount.lustre.0 00000100:00100000:0.0:1788841365.772808:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 25 00000100:00100000:0.0:1788841365.772814:0:24278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b81b23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2399:x1875735392448000:12345-192.168.204.7@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788841365.772827:0:24279:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0@192.168.204.7@tcp t0 exp 0000000000000000 cur 799 last 0 00010000:00080000:0.0:1788841365.772859:0:24278:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0@192.168.204.7@tcp t0 exp 0000000000000000 cur 799 last 0 00000020:00000080:3.0:1788841365.772903:0:24279:0:(genops.c:1385:class_connect()) connect: client d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0, cookie 0x5757cd208ac385fa 00000020:00000080:0.0:1788841365.772903:0:24278:0:(genops.c:1385:class_connect()) connect: client d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0, cookie 0x5757cd208ac38601 00002000:00100000:0.0:1788841365.772923:0:24278:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0/ffffa04b58065800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113972 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788841365.772927:0:24279:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0/ffffa04b7f6f9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113972 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788841365.772938:0:24279:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00100000:0.0:1788841365.772938:0:24278:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788841365.773017:0:24279:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00002000:00080000:0.0:1788841365.773017:0:24278:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788841365.773053:0:24279:0:(import.c:65:import_set_state_nolock()) ffffa04a4784d800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1788841365.773053:0:24278:0:(import.c:65:import_set_state_nolock()) ffffa04b58061800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788841365.773168:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392448128 00000100:00100000:1.0:1788841365.773174:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392448128 00000100:00100000:1.0:1788841365.773231:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 4 00000100:00100000:1.0:1788841365.773239:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b81b21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+6:18281:x1875735392448128:12345-192.168.204.7@tcp:900:mount.lustre.0 00000100:00100000:0.0:1788841365.773367:0:24278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b81b23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+6:2399:x1875735392448000:12345-192.168.204.7@tcp:8:mount.lustre.0 Request processed in 550us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841365.773386:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 25 00000100:00100000:3.0:1788841365.777450:0:24279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b81b20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+6:2399:x1875735392447872:12345-192.168.204.7@tcp:8:mount.lustre.0 Request processed in 4647us (4847us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841365.777470:0:24279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 24 00000100:00100000:1.0:1788841365.777516:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b81b21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+6:18281:x1875735392448128:12345-192.168.204.7@tcp:900:mount.lustre.0 Request processed in 4192us (4939us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841365.777528:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 4 00000100:00100000:2.0:1788841365.780725:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:0.0:1788841365.780963:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392448256 00000100:00100000:0.0:1788841365.780978:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392448256 00000100:00100000:0.0:1788841365.781074:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 1 00000100:00100000:0.0:1788841365.781087:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7f84ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+6:18281:x1875735392448256:12345-192.168.204.7@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788841365.781214:0:22776:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788841365.781355:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7f84ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+6:18281:x1875735392448256:12345-192.168.204.7@tcp:33:mount.lustre.0 Request processed in 269us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841365.781364:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 1 00010000:00010000:2.0:1788841365.837082:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788841365.938964:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:2.0:1788841365.939225:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392448384 00000100:00100000:2.0:1788841365.939241:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392448384 00000100:00100000:2.0:1788841365.939366:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 22 00000100:00100000:2.0:1788841365.939380:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7f88f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+6:18312:x1875735392448384:12345-192.168.204.7@tcp:101:mkdir.0 00010000:00010000:2.0:1788841365.939407:0:22773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841365.939448:0:22773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3c00/0x5757cd208ac38608 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x56167be89bd53b00 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841365.939584:0:22773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3400/0x5757cd208ac3860f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841365.939610:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3400/0x5757cd208ac3860f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841365.939626:0:22773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3400/0x5757cd208ac3860f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788841365.939693:0:22773:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788841365.939697:0:22773:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788841365.939726:0:22773:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3400/0x5757cd208ac3860f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841365.939760:0:22773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3c00/0x5757cd208ac38608 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b00 expref: 8 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841365.939788:0:22773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3400/0x5757cd208ac3860f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b00 expref: 7 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841365.939800:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa04b7f760c00) 00010000:00010000:2.0:1788841365.939804:0:22773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788841365.939808:0:22773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04b67bb3400, rc 0) 00000100:00100000:2.0:1788841365.939969:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7f88f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+7:18312:x1875735392448384:12345-192.168.204.7@tcp:101:mkdir.0 Request processed in 591us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841365.939978:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 22 00000100:00100000:0.0:1788841366.541258:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788841366.541292:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7f88c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875735413538432:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788841366.541391:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841366.541470:0:24282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413538432 00000100:00100000:0.0:1788841366.541480:0:24282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413538432 00000100:00100000:0.0:1788841366.541562:0:24282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788841366.541573:0:24282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7f88c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875735413538432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788841366.541732:0:24282:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788841366.541786:0:24282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7f88c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875735413538432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 215us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841366.541794:0:24282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1788841366.541818:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788841366.541891:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7f88c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875735413538432:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788841366.861951:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788841367.053074:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7f88c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875735413538560:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788841367.053177:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841367.053283:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413538560 00000100:00100000:0.0:1788841367.053294:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413538560 00000100:00100000:0.0:1788841367.053359:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788841367.053371:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7f88e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875735413538560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788841367.053421:0:22778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788841367.053477:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7f88e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875735413538560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841367.053485:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788841367.053557:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7f88c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875735413538560:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788841367.053705:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b81b20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875735413538688:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788841367.053735:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841367.060214:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413538688 00000100:00100000:3.0:1788841367.060233:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413538688 00000100:00100000:3.0:1788841367.060314:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788841367.060324:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7f88c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875735413538688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788841367.060375:0:22778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788841367.060492:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7f88c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875735413538688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 168us (6755us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841367.060499:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788841367.060621:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b81b20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875735413538688:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788841367.565330:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b81b21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875735413538816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788841367.565466:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841367.565617:0:24282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413538816 00000100:00100000:3.0:1788841367.565627:0:24282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413538816 00000100:00100000:3.0:1788841367.565688:0:24282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788841367.565698:0:24282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b81b21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875735413538816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788841367.565729:0:24282:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788841367.565777:0:24282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b81b21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875735413538816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841367.565783:0:24282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1788841367.565809:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788841367.565894:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b81b21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875735413538816:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788841367.885003:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788841368.205486:0:22808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:2.0:1788841368.592400:0:24274:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0 00000001:00100000:2.0:1788841368.592412:0:24274:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fbb75a7f-409e-496d-8433-a98f63f91f81 00000001:00100000:0.0:1788841368.592787:0:23506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0 00000001:00100000:0.0:1788841368.592795:0:23506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of fbb75a7f-409e-496d-8433-a98f63f91f81 00000001:00100000:0.0:1788841368.601027:0:22752:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0 00000001:00100000:0.0:1788841368.601043:0:22752:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fbb75a7f-409e-496d-8433-a98f63f91f81 00000001:02000400:1.0:1788841368.807650:0:25650:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788841368.911788:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788841369.102252:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788841369.102277:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7f84d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875735413539072:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788841369.102419:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841369.102523:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fa04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875735413538944:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788841369.102549:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841369.102613:0:24282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413539072 00000100:00100000:1.0:1788841369.102622:0:24282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413539072 00000100:00100000:1.0:1788841369.102685:0:24282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413538944 00000100:00100000:1.0:1788841369.102688:0:24282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413538944 00000100:00100000:1.0:1788841369.102710:0:24282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788841369.102719:0:24282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7f84fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875735413539072:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788841369.102749:0:24282:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788841369.102800:0:24282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7f84fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875735413539072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841369.102807:0:24282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788841369.102823:0:24282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788841369.102850:0:24282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7f84f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875735413538944:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788841369.102934:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7f84d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875735413539072:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788841369.102980:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1788841369.103097:0:24282:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788841369.103140:0:24282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7f84f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875735413538944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 311us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841369.103147:0:24282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788841369.103203:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:1.0:1788841369.103221:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fa04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875735413538944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788841369.103601:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fb85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875735413539584:0@lo:400:kworker.0 00000100:00100000:3.0:1788841369.103636:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841369.103658:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875735413540096:0@lo:400:kworker.0 00000100:00100000:3.0:1788841369.103680:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841369.103699:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788841369.103705:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b81b21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a456da20-a415-4617-896c-ee7aa5e4c089:3649:1875735413539200:0@lo:400:kworker.0 00000100:00100000:3.0:1788841369.103884:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841369.103976:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fb87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875735413539712:0@lo:400:kworker.0 00000100:00100000:3.0:1788841369.104000:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841369.104016:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1875735413540224:0@lo:400:kworker.0 00000100:00100000:3.0:1788841369.104032:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841369.104057:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413539584 00000100:00100000:3.0:1788841369.104062:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413539584 00000100:00100000:3.0:1788841369.104159:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413540096 00000100:00100000:3.0:1788841369.104163:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413540096 00000100:00100000:3.0:1788841369.104182:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413540224 00000100:00100000:3.0:1788841369.104184:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413540224 00000100:00100000:3.0:1788841369.104196:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788841369.104203:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6e05f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875735413539584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841369.104434:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788841369.104442:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b41327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875735413540096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841369.104488:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6e05f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875735413539584:12345-0@lo:400:kworker.0 Request processed in 284us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841369.104495:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788841369.104513:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788841369.104519:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b41326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875735413540224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841369.104544:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b41327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875735413540096:12345-0@lo:400:kworker.0 Request processed in 103us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841369.104550:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788841369.104565:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b41326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875735413540224:12345-0@lo:400:kworker.0 Request processed in 47us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841369.104572:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788841369.104591:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413539712 00000100:00100000:3.0:1788841369.104596:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413539712 00000100:00100000:3.0:1788841369.104627:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788841369.104634:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b41326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875735413539712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841369.104664:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b41326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875735413539712:12345-0@lo:400:kworker.0 Request processed in 32us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841369.104670:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788841369.104706:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fb86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875735413539456:0@lo:400:kworker.0 00000100:00100000:3.0:1788841369.105009:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841369.105032:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04a47cbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875735413539968:0@lo:400:kworker.0 00000100:00100000:3.0:1788841369.105052:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841369.105066:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1875735413540480:0@lo:400:kworker.0 00000100:00100000:0.0:1788841369.105283:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413539968 00000100:00100000:0.0:1788841369.105288:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413539968 00000100:00100000:0.0:1788841369.105317:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788841369.105324:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b41324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875735413539968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841369.105358:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b41324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875735413539968:12345-0@lo:400:kworker.0 Request processed in 35us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841369.105373:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788841369.105448:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841369.105501:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04a47cbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875735413539968:0@lo:400:kworker.0 00000100:00100000:3.0:1788841369.105519:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788841369.105526:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b81b20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875735413539328:0@lo:400:kworker.0 00000100:00100000:3.0:1788841369.105550:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841369.105568:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fb84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875735413539840:0@lo:400:kworker.0 00000100:00100000:3.0:1788841369.105592:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841369.105609:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1875735413540352:0@lo:400:kworker.0 00000100:00100000:3.0:1788841369.105633:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841369.105663:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413540480 00000100:00100000:3.0:1788841369.105664:0:25016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413540352 00000100:00100000:3.0:1788841369.105667:0:25016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413540352 00000100:00100000:0.0:1788841369.105667:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413540480 00000100:00100000:3.0:1788841369.105693:0:25016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788841369.105700:0:25016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b41325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875735413540352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841369.105739:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413539200 00000100:00100000:2.0:1788841369.105744:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413539200 00000100:00100000:2.0:1788841369.105773:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788841369.105780:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a47cc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+24:3649:x1875735413539200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841369.105815:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a47cc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+24:3649:x1875735413539200:12345-0@lo:400:kworker.0 Request processed in 36us (1932us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841369.105821:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788841369.105968:0:25016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b41325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875735413540352:12345-0@lo:400:kworker.0 Request processed in 267us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841369.105974:0:25016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788841369.105988:0:25016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788841369.105994:0:25016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b41327800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875735413540480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841369.106023:0:25016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b41327800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875735413540480:12345-0@lo:400:kworker.0 Request processed in 30us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841369.106029:0:25016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788841369.107577:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fb85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875735413539584:0@lo:400:kworker.0 00000100:00100000:1.0:1788841369.107622:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875735413540096:0@lo:400:kworker.0 00000100:00100000:1.0:1788841369.107651:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b81b21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a456da20-a415-4617-896c-ee7aa5e4c089:3649:1875735413539200:0@lo:400:kworker.0 00000100:00100000:1.0:1788841369.107664:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fb87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875735413539712:0@lo:400:kworker.0 00010000:00080000:1.0:1788841369.107679:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa04b6e05ed80 x1875735413540224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788841369.107689:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1875735413540224:0@lo:400:kworker.0 00000100:00100000:1.0:1788841369.108002:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413539328 00000100:00100000:1.0:1788841369.108009:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413539328 00000100:00100000:1.0:1788841369.108058:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788841369.108067:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b41324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875735413539328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841369.108496:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b41324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875735413539328:12345-0@lo:400:kworker.0 Request processed in 428us (2942us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841369.108505:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:2.0:1788841369.109178:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788841369.109184:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788841369.109196:0:24716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413539456 00000100:00100000:2.0:1788841369.109202:0:24716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413539456 00000100:00100000:3.0:1788841369.109538:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b81b20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875735413539328:0@lo:400:kworker.0 00000100:00100000:3.0:1788841369.109556:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1875735413540352:0@lo:400:kworker.0 00010000:00080000:3.0:1788841369.109570:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa04b6e05d500 x1875735413540480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841369.109580:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1875735413540480:0@lo:400:kworker.0 00000100:00080000:0.0:1788841369.109724:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788841369.109767:0:24716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413539840 00000100:00100000:2.0:1788841369.109772:0:24716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413539840 00000100:00080000:1.0:1788841369.109877:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788841369.110125:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788841369.110136:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b41325880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875735413539456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841369.110222:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b41325880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875735413539456:12345-0@lo:400:kworker.0 Request processed in 89us (5214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841369.110229:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788841369.110245:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788841369.110250:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b582a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875735413539840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841369.110301:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b582a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875735413539840:12345-0@lo:400:kworker.0 Request processed in 51us (4709us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841369.110307:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788841369.110573:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fb84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875735413539840:0@lo:400:kworker.0 00000100:00100000:1.0:1788841369.110585:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fb86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875735413539456:0@lo:400:kworker.0 00010000:00010000:2.0:1788841369.933010:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788841370.958100:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788841371.028491:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:1.0:1788841371.028600:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:1.0:1788841371.028800:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:1.0:1788841371.028861:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:2.0:1788841371.028916:0:25016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392448640 00000100:00100000:2.0:1788841371.028926:0:25016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392448640 00000100:00100000:2.0:1788841371.028983:0:25016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392449152 00000100:00100000:2.0:1788841371.028987:0:25016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392449152 00000100:00100000:2.0:1788841371.029022:0:25016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 55 00000100:00100000:2.0:1788841371.029033:0:25016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7fa04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fbb75a7f-409e-496d-8433-a98f63f91f81+6:2400:x1875735392448640:12345-192.168.204.7@tcp:400:kworker.0 00000100:00100000:2.0:1788841371.029120:0:25016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7fa04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fbb75a7f-409e-496d-8433-a98f63f91f81+6:2400:x1875735392448640:12345-192.168.204.7@tcp:400:kworker.0 Request processed in 89us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841371.029129:0:25016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 55 00000100:00100000:2.0:1788841371.029146:0:25016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 56 00000100:00100000:2.0:1788841371.029151:0:25016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7fa06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+6:2400:x1875735392449152:12345-192.168.204.7@tcp:400:kworker.0 00000100:00100000:2.0:1788841371.029173:0:25016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7fa06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+6:2400:x1875735392449152:12345-192.168.204.7@tcp:400:kworker.0 Request processed in 22us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841371.029178:0:25016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 56 00000100:00100000:1.0:1788841371.030515:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:1.0:1788841371.030540:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:1.0:1788841371.030559:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:3.0:1788841371.030608:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392448512 00000100:00100000:3.0:1788841371.030615:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392448512 00000100:00100000:3.0:1788841371.030655:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 148 00000100:00100000:3.0:1788841371.030664:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a46968050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25ddc60b-4cfa-4441-9231-3253d5543004+13:2400:x1875735392448512:12345-192.168.204.7@tcp:400:kworker.0 00000100:00100000:3.0:1788841371.030721:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a46968050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25ddc60b-4cfa-4441-9231-3253d5543004+13:2400:x1875735392448512:12345-192.168.204.7@tcp:400:kworker.0 Request processed in 59us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841371.030728:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 148 00000100:00100000:0.0:1788841371.034985:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392448896 00000100:00100000:0.0:1788841371.035016:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392448896 00000100:00100000:0.0:1788841371.035104:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392449408 00000100:00100000:0.0:1788841371.035107:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392449408 00000100:00100000:0.0:1788841371.035144:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 14 00000100:00100000:0.0:1788841371.035155:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7fa04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fbb75a7f-409e-496d-8433-a98f63f91f81+5:2400:x1875735392448896:12345-192.168.204.7@tcp:400:kworker.0 00000100:00100000:0.0:1788841371.035247:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7fa04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fbb75a7f-409e-496d-8433-a98f63f91f81+5:2400:x1875735392448896:12345-192.168.204.7@tcp:400:kworker.0 Request processed in 94us (6646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841371.035255:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 14 00000100:00100000:0.0:1788841371.035274:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 15 00000100:00100000:0.0:1788841371.035281:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b81b23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+5:2400:x1875735392449408:12345-192.168.204.7@tcp:400:kworker.0 00000100:00100000:0.0:1788841371.035304:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b81b23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+5:2400:x1875735392449408:12345-192.168.204.7@tcp:400:kworker.0 Request processed in 23us (6443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841371.035310:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 15 00000100:00100000:3.0:1788841371.036982:0:25016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392448768 00000100:00100000:3.0:1788841371.036995:0:25016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392448768 00000100:00100000:3.0:1788841371.037071:0:25016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 57 00000100:00100000:3.0:1788841371.037097:0:25016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b81b23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fbb75a7f-409e-496d-8433-a98f63f91f81+5:2400:x1875735392448768:12345-192.168.204.7@tcp:400:kworker.0 00000100:00100000:3.0:1788841371.037168:0:25016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b81b23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fbb75a7f-409e-496d-8433-a98f63f91f81+5:2400:x1875735392448768:12345-192.168.204.7@tcp:400:kworker.0 Request processed in 77us (6626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841371.037175:0:25016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 57 00000100:00100000:0.0:1788841371.038146:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392449024 00000100:00100000:0.0:1788841371.038155:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392449024 00000100:00100000:0.0:1788841371.038250:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 16 00000100:00100000:0.0:1788841371.038260:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b81b20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fbb75a7f-409e-496d-8433-a98f63f91f81+5:2400:x1875735392449024:12345-192.168.204.7@tcp:400:kworker.0 00000100:00100000:0.0:1788841371.038309:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b81b20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fbb75a7f-409e-496d-8433-a98f63f91f81+5:2400:x1875735392449024:12345-192.168.204.7@tcp:400:kworker.0 Request processed in 52us (7748us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841371.038316:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 16 00000100:00100000:1.0:1788841371.038410:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:1.0:1788841371.038488:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00080000:1.0:1788841371.042404:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788841371.042415:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788841371.042418:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788841371.042421:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788841371.042452:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392449280 00000100:00100000:1.0:1788841371.042463:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392449280 00000100:00100000:1.0:1788841371.042540:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 58 00000100:00100000:1.0:1788841371.042552:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b81b20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+5:2400:x1875735392449280:12345-192.168.204.7@tcp:400:kworker.0 00000100:00100000:1.0:1788841371.042634:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b81b20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+5:2400:x1875735392449280:12345-192.168.204.7@tcp:400:kworker.0 Request processed in 84us (4225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841371.042642:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 58 00000100:00080000:1.0:1788841371.042700:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788841371.042819:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392449536 00000100:00100000:2.0:1788841371.042825:0:24278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392449536 00000100:00100000:2.0:1788841371.042892:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 17 00000100:00100000:2.0:1788841371.042900:0:24278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b81b21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+6:2400:x1875735392449536:12345-192.168.204.7@tcp:400:kworker.0 00000100:00100000:2.0:1788841371.042935:0:24278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b81b21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+6:2400:x1875735392449536:12345-192.168.204.7@tcp:400:kworker.0 Request processed in 36us (4447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841371.042942:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 17 00000100:00080000:1.0:1788841371.043041:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788841371.666108:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788841371.666139:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b41325880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875735413540608:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788841371.666232:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841371.668095:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413540608 00000100:00100000:3.0:1788841371.668111:0:24280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413540608 00000100:00100000:3.0:1788841371.668218:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788841371.668232:0:24280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7f84d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875735413540608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788841371.668279:0:24280:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788841371.668387:0:24280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7f84d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875735413540608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 157us (2154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841371.668395:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788841371.668496:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b41325880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875735413540608:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788841371.668597:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1788841371.674723:0:25093:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0 00010000:00010000:2.0:1788841371.981969:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788841372.173009:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788841372.173040:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7f88d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875735413540736:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788841372.173135:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841372.173370:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413540736 00000100:00100000:3.0:1788841372.173382:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413540736 00000100:00100000:3.0:1788841372.173451:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788841372.173462:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7f88df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875735413540736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788841372.173857:0:22778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788841372.173926:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7f88df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875735413540736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 465us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841372.173934:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788841372.174050:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7f88d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875735413540736:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788841372.174099:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b41325880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875735413540864:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788841372.174141:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841372.174235:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413540864 00000100:00100000:0.0:1788841372.174241:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413540864 00000100:00100000:0.0:1788841372.174277:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788841372.174285:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6e05d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875735413540864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788841372.174309:0:22777:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788841372.174707:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6e05d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875735413540864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 421us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841372.174715:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788841372.179666:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b41325880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875735413540864:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788841372.686066:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788841372.686098:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b41324e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875735413540992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788841372.686394:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841372.686734:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413540992 00000100:00100000:3.0:1788841372.686746:0:24280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413540992 00000100:00080000:0.0:1788841372.686861:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788841372.686874:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788841372.686888:0:24280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7f88d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875735413540992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788841372.687260:0:24280:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788841372.687347:0:24280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7f88d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875735413540992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 462us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841372.687355:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788841372.687452:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b41324e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875735413540992:0@lo:13:osp-pre-0-0.0 00000020:00000080:2.0:1788841372.809604:0:25797:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeaff26760 20000000:00000080:2.0:1788841372.809634:0:25797:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa04b7d5ef400 uarg=0000000000000000 20000000:01000000:2.0:1788841372.809782:0:25797:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788841372.809788:0:25797:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788841372.809793:0:25797:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788841372.810671:0:25798:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:1.0:1788841372.810930:0:25797:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788841372.818425:0:25797:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788841372.818460:0:25797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa04b48dc6c00/0x5757cd208ac38616 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841372.818491:0:25797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa04b81b5c000/0x5757cd208ac38273 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5757cd208ac3826c expref: 23 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841372.818500:0:25797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa04b7a723800/0x5757cd208ac38281 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5757cd208ac3827a expref: 23 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841372.818507:0:25797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa04b7a722e00/0x5757cd208ac382c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5757cd208ac382b9 expref: 23 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841372.818533:0:25797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa04b67bb3800/0x5757cd208ac38441 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5757cd208ac3843a expref: 23 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841372.818545:0:25797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa04b7f8c5800/0x5757cd208ac385a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53a5f expref: 12 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841372.818553:0:25797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa04a4750a200/0x5757cd208ac385e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53acf expref: 12 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841372.818561:0:25797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa04b48dc6c00/0x5757cd208ac38616 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841372.818609:0:25797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa04a4750a200/0x5757cd208ac385e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.7@tcp remote: 0x56167be89bd53acf expref: 12 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841372.818628:0:25797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa04a4750a200/0x5757cd208ac385e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.7@tcp remote: 0x56167be89bd53acf expref: 12 pid: 22766 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841372.818645:0:25797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25797:1875735413541120:192.168.204.7@tcp:104: 00010000:00010000:1.0:1788841372.818769:0:25797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa04b7f8c5800/0x5757cd208ac385a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.7@tcp remote: 0x56167be89bd53a5f expref: 12 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841372.818778:0:25797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa04b7f8c5800/0x5757cd208ac385a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.7@tcp remote: 0x56167be89bd53a5f expref: 12 pid: 22767 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841372.818787:0:25797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25797:1875735413541248:192.168.204.7@tcp:104: 00010000:00010000:1.0:1788841372.818816:0:25797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa04b67bb3800/0x5757cd208ac38441 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5757cd208ac3843a expref: 23 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841372.820073:0:25797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa04b67bb3800/0x5757cd208ac38441 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5757cd208ac3843a expref: 23 pid: 22766 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841372.820088:0:25797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25797:1875735413541376:0@lo:104: 00000100:00100000:1.0:1788841372.820141:0:25797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788841372.820187:0:25797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa04b7a722e00/0x5757cd208ac382c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5757cd208ac382b9 expref: 23 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841372.820196:0:25797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa04b7a722e00/0x5757cd208ac382c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5757cd208ac382b9 expref: 23 pid: 22764 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841372.820276:0:25797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25797:1875735413541504:0@lo:104: 00000100:00100000:1.0:1788841372.820311:0:25797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841372.820341:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413541376 00000100:00100000:1.0:1788841372.820347:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413541376 00000100:00100000:1.0:1788841372.820388:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413541504 00000100:00100000:1.0:1788841372.820391:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413541504 00000100:00100000:1.0:1788841372.820417:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788841372.820427:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6e05ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a456da20-a415-4617-896c-ee7aa5e4c089+4:25797:x1875735413541376:12345-0@lo:104: 00010000:00010000:1.0:1788841372.820439:0:22756:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.107@tcp lock: ffffa04b48dc7e00/0x5757cd208ac3843a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5757cd208ac38441 expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841372.820494:0:22756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788841372.820500:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6e05ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a456da20-a415-4617-896c-ee7aa5e4c089+4:25797:x1875735413541376:12345-0@lo:104: Request processed in 75us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841372.820507:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788841372.820525:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788841372.820530:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7fb86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a456da20-a415-4617-896c-ee7aa5e4c089+3:25797:x1875735413541504:12345-0@lo:104: 00010000:00010000:1.0:1788841372.820549:0:22756:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.107@tcp lock: ffffa04b81b5c400/0x5757cd208ac382b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5757cd208ac382c0 expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841372.820590:0:22756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788841372.820595:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7fb86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a456da20-a415-4617-896c-ee7aa5e4c089+3:25797:x1875735413541504:12345-0@lo:104: Request processed in 66us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841372.820602:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1788841372.820609:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788841372.820616:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.107@tcp lock: ffffa04b48dc7e00/0x5757cd208ac3843a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5757cd208ac38441 expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841372.820623:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b48dc7e00 already unused, calling callback (ffffffffc11a4c20) 10000000:00010000:2.0:1788841372.820627:0:22760:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.107@tcp lock: ffffa04b48dc7e00/0x5757cd208ac3843a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5757cd208ac38441 expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841372.820628:0:25797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa04b7a723800/0x5757cd208ac38281 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5757cd208ac3827a expref: 23 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841372.820637:0:25797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa04b7a723800/0x5757cd208ac38281 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5757cd208ac3827a expref: 23 pid: 22766 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841372.820638:0:22760:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.107@tcp lock: ffffa04b48dc7e00/0x5757cd208ac3843a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5757cd208ac38441 expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788841372.820646:0:22760:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.107@tcp lock: ffffa04b48dc7e00/0x5757cd208ac3843a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5757cd208ac38441 expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841372.820647:0:25797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fb84e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25797:1875735413541632:0@lo:104: 10000000:01000000:2.0:1788841372.820652:0:22760:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1788841372.820667:0:25797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788841372.820680:0:22760:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.107@tcp lock: ffffa04b48dc7e00/0x5757cd208ac3843a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5757cd208ac38441 expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841372.820683:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413541632 00000100:00100000:1.0:1788841372.820686:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413541632 00010000:00010000:2.0:1788841372.820687:0:22760:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788841372.820701:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788841372.820705:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7fb87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a456da20-a415-4617-896c-ee7aa5e4c089+3:25797:x1875735413541632:12345-0@lo:104: 00010000:00010000:2.0:1788841372.820706:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.107@tcp lock: ffffa04b48dc7e00/0x5757cd208ac3843a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5757cd208ac38441 expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841372.820712:0:22756:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.107@tcp lock: ffffa04b81b5d800/0x5757cd208ac3827a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5757cd208ac38281 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841372.820713:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.107@tcp lock: ffffa04b48dc7e00/0x5757cd208ac3843a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5757cd208ac38441 expref: -99 pid: 25092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841372.820737:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788841372.820737:0:22756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1788841372.820741:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.107@tcp lock: ffffa04b81b5c400/0x5757cd208ac382b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5757cd208ac382c0 expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841372.820742:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7fb87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a456da20-a415-4617-896c-ee7aa5e4c089+3:25797:x1875735413541632:12345-0@lo:104: Request processed in 36us (74us total) trans 0 rc 0/0 00010000:00010000:2.0:1788841372.820747:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b81b5c400 already unused, calling callback (ffffffffc11a4c20) 00000100:00100000:1.0:1788841372.820747:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 10000000:00010000:2.0:1788841372.820750:0:22760:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.107@tcp lock: ffffa04b81b5c400/0x5757cd208ac382b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5757cd208ac382c0 expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841372.820757:0:22760:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.107@tcp lock: ffffa04b81b5c400/0x5757cd208ac382b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5757cd208ac382c0 expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788841372.820763:0:22760:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.107@tcp lock: ffffa04b81b5c400/0x5757cd208ac382b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5757cd208ac382c0 expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788841372.820768:0:22760:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788841372.820769:0:25797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa04b81b5c000/0x5757cd208ac38273 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5757cd208ac3826c expref: 23 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841372.820780:0:22760:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.107@tcp lock: ffffa04b81b5c400/0x5757cd208ac382b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5757cd208ac382c0 expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841372.820785:0:22760:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788841372.820786:0:25797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa04b81b5c000/0x5757cd208ac38273 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5757cd208ac3826c expref: 23 pid: 22766 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841372.820791:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.107@tcp lock: ffffa04b81b5c400/0x5757cd208ac382b9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5757cd208ac382c0 expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841372.820794:0:25797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fb85f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25797:1875735413541888:0@lo:104: 00010000:00010000:2.0:1788841372.820798:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.107@tcp lock: ffffa04b81b5c400/0x5757cd208ac382b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5757cd208ac382c0 expref: -99 pid: 24273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841372.820806:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788841372.820809:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.107@tcp lock: ffffa04b81b5d800/0x5757cd208ac3827a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5757cd208ac38281 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841372.820814:0:25797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788841372.820825:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b81b5d800 already unused, calling callback (ffffffffc11a4c20) 10000000:00010000:2.0:1788841372.820828:0:22760:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.107@tcp lock: ffffa04b81b5d800/0x5757cd208ac3827a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5757cd208ac38281 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841372.820830:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413541888 00010000:00010000:2.0:1788841372.820864:0:22760:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.107@tcp lock: ffffa04b81b5d800/0x5757cd208ac3827a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5757cd208ac38281 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788841372.820871:0:22760:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.107@tcp lock: ffffa04b81b5d800/0x5757cd208ac3827a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5757cd208ac38281 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788841372.820876:0:22760:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788841372.820890:0:22760:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.107@tcp lock: ffffa04b81b5d800/0x5757cd208ac3827a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5757cd208ac38281 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841372.820895:0:22760:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788841372.820910:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.107@tcp lock: ffffa04b81b5d800/0x5757cd208ac3827a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5757cd208ac38281 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841372.820916:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.107@tcp lock: ffffa04b81b5d800/0x5757cd208ac3827a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5757cd208ac38281 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841372.820925:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841372.820927:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841372.820929:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788841372.820950:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788841372.820961:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7f84ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a456da20-a415-4617-896c-ee7aa5e4c089:3652:1875735413542144:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788841372.820991:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788841372.821051:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788841372.821063:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7f84c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a456da20-a415-4617-896c-ee7aa5e4c089:3650:1875735413542016:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788841372.821091:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841372.822361:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7f84f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a456da20-a415-4617-896c-ee7aa5e4c089:3649:1875735413541760:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788841372.822427:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841372.824810:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413541888 00000100:00100000:1.0:1788841372.825000:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788841372.825014:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7fb86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a456da20-a415-4617-896c-ee7aa5e4c089+3:25797:x1875735413541888:12345-0@lo:104: 00010000:00010000:1.0:1788841372.825032:0:22756:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.107@tcp lock: ffffa04b7a723400/0x5757cd208ac3826c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5757cd208ac38273 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841372.825096:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413542144 00000100:00100000:2.0:1788841372.825101:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413542144 00010000:00010000:1.0:1788841372.825117:0:22756:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788841372.825122:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7fb86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a456da20-a415-4617-896c-ee7aa5e4c089+3:25797:x1875735413541888:12345-0@lo:104: Request processed in 111us (4307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841372.825129:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1788841372.825130:0:22758:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa04b7a723800/0x5757cd208ac38281 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5757cd208ac3827a expref: 24 pid: 22766 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841372.825144:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413542016 00000100:00100000:2.0:1788841372.825147:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413542016 00010000:00010000:2.0:1788841372.825157:0:22758:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa04b7a722e00/0x5757cd208ac382c0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5757cd208ac382b9 expref: 25 pid: 22764 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841372.825166:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413541760 00000100:00100000:1.0:1788841372.825167:0:25797:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b7fe02f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788841372.825168:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413541760 00010000:00010000:2.0:1788841372.825178:0:22758:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa04b67bb3800/0x5757cd208ac38441 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5757cd208ac3843a expref: 26 pid: 22766 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841372.825188:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788841372.825191:0:25797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25797:1875735413541376:0@lo:104: 00000100:00100000:2.0:1788841372.825193:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7f84df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a456da20-a415-4617-896c-ee7aa5e4c089+26:3652:x1875735413542144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788841372.825203:0:22758:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788841372.825208:0:22758:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa04b7a723800/0x5757cd208ac38281 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5757cd208ac3827a expref: 26 pid: 22766 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841372.825218:0:22758:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa04b7a723800/0x5757cd208ac38281 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5757cd208ac3827a expref: 26 pid: 22766 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841372.825236:0:22758:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788841372.825267:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7f84df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a456da20-a415-4617-896c-ee7aa5e4c089+26:3652:x1875735413542144:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (4276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841372.825273:0:25797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25797:1875735413541504:0@lo:104: 00000100:00100000:2.0:1788841372.825274:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1788841372.825287:0:25797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa04b7a723800/0x5757cd208ac38281 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5757cd208ac3827a expref: 25 pid: 22766 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841372.825288:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788841372.825294:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b41326300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a456da20-a415-4617-896c-ee7aa5e4c089+25:3650:x1875735413542016:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788841372.825298:0:25797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fb84e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25797:1875735413541632:0@lo:104: 00010000:00010000:2.0:1788841372.825301:0:22758:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788841372.825304:0:22758:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa04b7a722e00/0x5757cd208ac382c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5757cd208ac382b9 expref: 24 pid: 22764 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841372.825318:0:22758:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa04b7a722e00/0x5757cd208ac382c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5757cd208ac382b9 expref: 24 pid: 22764 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841372.825327:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa04b7a722e00/0x5757cd208ac382c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5757cd208ac382b9 expref: 24 pid: 22764 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841372.825336:0:22758:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788841372.825360:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b41326300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a456da20-a415-4617-896c-ee7aa5e4c089+23:3650:x1875735413542016:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (4268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841372.825366:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788841372.825378:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788841372.825378:0:25797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fb85f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25797:1875735413541888:0@lo:104: 00000100:00100000:2.0:1788841372.825383:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7f88dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a456da20-a415-4617-896c-ee7aa5e4c089+22:3649:x1875735413541760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788841372.825390:0:22758:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788841372.825394:0:22758:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa04b67bb3800/0x5757cd208ac38441 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5757cd208ac3843a expref: 22 pid: 22766 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841372.825414:0:22758:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa04b67bb3800/0x5757cd208ac38441 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5757cd208ac3843a expref: 22 pid: 22766 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841372.825424:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa04b67bb3800/0x5757cd208ac38441 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5757cd208ac3843a expref: 22 pid: 22766 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841372.825432:0:22758:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788841372.825448:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7f84c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a456da20-a415-4617-896c-ee7aa5e4c089:3650:1875735413542016:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788841372.825459:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7f88dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a456da20-a415-4617-896c-ee7aa5e4c089+21:3649:x1875735413541760:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (3033us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841372.825463:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788841372.825719:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7f84ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a456da20-a415-4617-896c-ee7aa5e4c089:3652:1875735413542144:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788841372.825739:0:22760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788841372.825751:0:22760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.107@tcp lock: ffffa04b7a723400/0x5757cd208ac3826c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5757cd208ac38273 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841372.825758:0:22760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b7a723400 already unused, calling callback (ffffffffc11a4c20) 10000000:00010000:2.0:1788841372.825762:0:22760:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.107@tcp lock: ffffa04b7a723400/0x5757cd208ac3826c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5757cd208ac38273 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841372.825770:0:22760:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.107@tcp lock: ffffa04b7a723400/0x5757cd208ac3826c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5757cd208ac38273 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788841372.825777:0:22760:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.107@tcp lock: ffffa04b7a723400/0x5757cd208ac3826c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5757cd208ac38273 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788841372.825783:0:22760:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788841372.828109:0:22760:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.107@tcp lock: ffffa04b7a723400/0x5757cd208ac3826c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5757cd208ac38273 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841372.828125:0:22760:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788841372.828132:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7f84f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a456da20-a415-4617-896c-ee7aa5e4c089:3649:1875735413541760:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788841372.828145:0:22760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.107@tcp lock: ffffa04b7a723400/0x5757cd208ac3826c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5757cd208ac38273 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841372.828151:0:22760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.107@tcp lock: ffffa04b7a723400/0x5757cd208ac3826c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5757cd208ac38273 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841372.828167:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1788841372.828172:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841372.828174:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788841372.828176:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788841372.828178:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7f84ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a456da20-a415-4617-896c-ee7aa5e4c089:3651:1875735413542272:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788841372.828250:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841372.828297:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413542272 00000100:00100000:0.0:1788841372.828436:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413542272 00010000:00010000:0.0:1788841372.828478:0:22759:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa04b81b5c000/0x5757cd208ac38273 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5757cd208ac3826c expref: 21 pid: 22766 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841372.828518:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788841372.828526:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7f88f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a456da20-a415-4617-896c-ee7aa5e4c089+21:3651:x1875735413542272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788841372.828538:0:22759:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788841372.828542:0:22759:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa04b81b5c000/0x5757cd208ac38273 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5757cd208ac3826c expref: 21 pid: 22766 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841372.828551:0:22759:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa04b81b5c000/0x5757cd208ac38273 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5757cd208ac3826c expref: 21 pid: 22766 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841372.828566:0:22759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa04b81b5c000/0x5757cd208ac38273 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5757cd208ac3826c expref: 21 pid: 22766 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841372.828578:0:22759:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788841372.828607:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7f88f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a456da20-a415-4617-896c-ee7aa5e4c089+20:3651:x1875735413542272:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841372.828613:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788841372.828638:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7f84ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a456da20-a415-4617-896c-ee7aa5e4c089:3651:1875735413542272:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788841372.831637:0:25797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25797:1875735413541120:192.168.204.7@tcp:104: 00000100:00100000:1.0:1788841372.838655:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:1.0:1788841372.838708:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:0.0:1788841372.839392:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392449664 00000100:00100000:0.0:1788841372.839415:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392449664 00010000:00010000:0.0:1788841372.839459:0:22759:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa04a4750a200/0x5757cd208ac385e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.7@tcp remote: 0x56167be89bd53acf expref: 13 pid: 22766 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841372.839604:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392449792 00000100:00100000:0.0:1788841372.839608:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392449792 00010000:00010000:0.0:1788841372.839626:0:22759:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa04b7f8c5800/0x5757cd208ac385a6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.7@tcp remote: 0x56167be89bd53a5f expref: 14 pid: 22767 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841372.839809:0:25797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25797:1875735413541248:192.168.204.7@tcp:104: 00010000:00010000:2.0:1788841372.839882:0:25797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa04b48dc6c00/0x5757cd208ac38616 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841372.840058:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 13 00000100:00100000:1.0:1788841372.840070:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7cb42050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:25ddc60b-4cfa-4441-9231-3253d5543004+14:2400:x1875735392449664:12345-192.168.204.7@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788841372.840084:0:22758:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788841372.840091:0:22758:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa04a4750a200/0x5757cd208ac385e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.7@tcp remote: 0x56167be89bd53acf expref: 14 pid: 22766 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841372.840104:0:22758:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa04a4750a200/0x5757cd208ac385e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.7@tcp remote: 0x56167be89bd53acf expref: 14 pid: 22766 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841372.840122:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa04a4750a200/0x5757cd208ac385e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.7@tcp remote: 0x56167be89bd53acf expref: 14 pid: 22766 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841372.840135:0:22758:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788841372.840200:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7cb42050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:25ddc60b-4cfa-4441-9231-3253d5543004+13:2400:x1875735392449664:12345-192.168.204.7@tcp:103:ldlm_bl.0 Request processed in 132us (1558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841372.840279:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 13 00000100:00100000:1.0:1788841372.840416:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 14 00000100:00100000:1.0:1788841372.840424:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7fb87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:25ddc60b-4cfa-4441-9231-3253d5543004+12:2400:x1875735392449792:12345-192.168.204.7@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788841372.840432:0:22758:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788841372.840436:0:22758:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa04b7f8c5800/0x5757cd208ac385a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.7@tcp remote: 0x56167be89bd53a5f expref: 12 pid: 22767 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841372.840446:0:22758:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa04b7f8c5800/0x5757cd208ac385a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.7@tcp remote: 0x56167be89bd53a5f expref: 12 pid: 22767 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841372.840457:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa04b7f8c5800/0x5757cd208ac385a6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.7@tcp remote: 0x56167be89bd53a5f expref: 12 pid: 22767 timeout: 907 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841372.840489:0:22758:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa04b48dc6c00/0x5757cd208ac38616 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841372.840497:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa04b48dc6c00/0x5757cd208ac38616 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841372.840513:0:22758:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa04b48dc6c00/0x5757cd208ac38616 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841372.840520:0:22758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa04b48dc6c00/0x5757cd208ac38616 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841372.840527:0:22758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa04b48dc6c00/0x5757cd208ac38616 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841372.840534:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa04b48dc6c00/0x5757cd208ac38616 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841372.840540:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b48dc6c00 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:1.0:1788841372.840544:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa04b48dc6c00/0x5757cd208ac38616 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841372.840552:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa04b48dc6c00/0x5757cd208ac38616 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841372.840574:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa04b48dc6c00/0x5757cd208ac38616 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841372.840585:0:22758:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788841372.840606:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7fb87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:25ddc60b-4cfa-4441-9231-3253d5543004+11:2400:x1875735392449792:12345-192.168.204.7@tcp:103:ldlm_bl.0 Request processed in 184us (1898us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841372.840619:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 14 00010000:00010000:3.0:1788841372.840730:0:25797:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa04b48dc6c00/0x5757cd208ac38616 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841372.840737:0:25797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa04b48dc6c00/0x5757cd208ac38616 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841372.840752:0:25797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa04b48dc6c00/0x5757cd208ac38616 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841373.005026:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788841373.901492:0:22769:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788841373.901500:0:22769:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa04b7fe3a000 from 13 10000000:01000000:1.0:1788841373.901506:0:22769:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788841373.901558:0:22769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b48dc7a00/0x5757cd208ac3861d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841373.901569:0:22769:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.107@tcp lock: ffffa04b48dc7a00/0x5757cd208ac3861d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841373.901580:0:22769:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.107@tcp lock: ffffa04b48dc7a00/0x5757cd208ac3861d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841373.901608:0:22769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fb85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413542400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788841373.901692:0:22769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841373.901749:0:22769:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b5f7f1540 going to sleep for 11 seconds 00000100:00100000:3.0:1788841373.903373:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413542400 00000100:00100000:3.0:1788841373.903397:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413542400 00000100:00100000:3.0:1788841373.903473:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788841373.903483:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a46968450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+20:22769:x1875735413542400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788841373.903502:0:22767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788841373.903522:0:22767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa04b7f8c5c00/0x5757cd208ac38624 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5757cd208ac3861d expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841373.903553:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa04b7f8c5c00/0x5757cd208ac38624 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5757cd208ac3861d expref: 21 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841373.903564:0:22767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa04b7f8c5c00/0x5757cd208ac38624 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5757cd208ac3861d expref: 21 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841373.903572:0:22767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04b7f8c5c00, rc 0) 00000100:00100000:3.0:1788841373.903661:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a46968450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+21:22769:x1875735413542400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (1968us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841373.903668:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788841373.905482:0:22769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fb85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413542400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788841373.905514:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.107@tcp lock: ffffa04b48dc7a00/0x5757cd208ac3861d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac38624 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841373.905527:0:22769:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.107@tcp lock: ffffa04b48dc7a00/0x5757cd208ac3861d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5757cd208ac38624 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841373.905618:0:22769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fb85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413542528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788841373.905676:0:22769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841373.905731:0:22769:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b5f7f1540 going to sleep for 11 seconds 00000100:00100000:2.0:1788841373.905859:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413542528 00000100:00100000:2.0:1788841373.905865:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413542528 00000100:00100000:2.0:1788841373.905913:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788841373.905922:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a4696a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+21:22769:x1875735413542528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788841373.906051:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a4696a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+21:22769:x1875735413542528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841373.906058:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788841373.906177:0:22769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fb85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413542528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788841373.906226:0:22769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fb85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413542656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788841373.906276:0:22769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841373.906300:0:22769:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b5f7f1540 going to sleep for 11 seconds 00000100:00100000:2.0:1788841373.906414:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413542656 00000100:00100000:2.0:1788841373.906419:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413542656 00000100:00100000:2.0:1788841373.906454:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788841373.906462:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a4696b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+21:22769:x1875735413542656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788841373.906544:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a4696b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+21:22769:x1875735413542656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841373.906552:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788841373.906705:0:22769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fb85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413542656:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788841373.909204:0:25810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788841373.909556:0:22769:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788841373.909581:0:22769:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.107@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788841373.909594:0:22769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b48dc7a00/0x5757cd208ac3861d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac38624 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841373.909607:0:22769:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.107@tcp lock: ffffa04b48dc7a00/0x5757cd208ac3861d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac38624 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788841373.909618:0:22769:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788841373.909621:0:22769:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa04a45ff0800 from 13 10000000:01000000:1.0:1788841373.909624:0:22769:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788841373.909661:0:22769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b48dc6200/0x5757cd208ac3862b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841373.909669:0:22769:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.107@tcp lock: ffffa04b48dc6200/0x5757cd208ac3862b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841373.909679:0:22769:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.107@tcp lock: ffffa04b48dc6200/0x5757cd208ac3862b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841373.909704:0:22769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fb85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413542784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788841373.909777:0:22769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841373.909827:0:22769:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b7d0f7240 going to sleep for 11 seconds 00000100:00100000:3.0:1788841373.909921:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413542784 00000100:00100000:3.0:1788841373.909930:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413542784 00000100:00100000:3.0:1788841373.909980:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788841373.909990:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a46969450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+21:22769:x1875735413542784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788841373.910004:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788841373.910025:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa04b7f8c5400/0x5757cd208ac38632 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5757cd208ac3862b expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841373.910050:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa04b7f8c5400/0x5757cd208ac38632 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5757cd208ac3862b expref: 22 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841373.910060:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa04b7f8c5400/0x5757cd208ac38632 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5757cd208ac3862b expref: 22 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841373.910069:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04b7f8c5400, rc 0) 00000100:00100000:3.0:1788841373.910112:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a46969450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+22:22769:x1875735413542784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841373.910118:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788841373.911509:0:22769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fb85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413542784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788841373.911537:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.107@tcp lock: ffffa04b48dc6200/0x5757cd208ac3862b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac38632 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841373.911549:0:22769:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.107@tcp lock: ffffa04b48dc6200/0x5757cd208ac3862b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5757cd208ac38632 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841373.911636:0:22769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7f88ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413542912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788841373.911689:0:22769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841373.912205:0:22769:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b6d4cfcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788841373.915030:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413542912 00000100:00100000:3.0:1788841373.915045:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413542912 00000100:00100000:3.0:1788841373.915258:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788841373.915270:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a4696a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+22:22769:x1875735413542912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788841373.915466:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a4696a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a456da20-a415-4617-896c-ee7aa5e4c089+22:22769:x1875735413542912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 198us (3775us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841373.915474:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788841373.915579:0:22769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7f88ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413542912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788841373.915640:0:22769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7f88ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413543040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788841373.915698:0:22769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841373.922769:0:22769:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b6d4cfcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788841373.925105:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413543040 00000100:00100000:2.0:1788841373.925120:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413543040 00000100:00100000:2.0:1788841373.925191:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788841373.925202:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a4696ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+22:22769:x1875735413543040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788841373.925395:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a4696ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+22:22769:x1875735413543040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 194us (9696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841373.925404:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788841373.925566:0:22769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7f88ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413543040:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788841373.930996:0:25811:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788841373.931465:0:22769:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788841373.931508:0:22769:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.107@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788841373.931521:0:22769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b48dc6200/0x5757cd208ac3862b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac38632 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841373.931534:0:22769:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.107@tcp lock: ffffa04b48dc6200/0x5757cd208ac3862b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac38632 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788841373.931545:0:22769:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788841373.931547:0:22769:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa04b521ab000 from 13 10000000:01000000:1.0:1788841373.931550:0:22769:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788841373.931590:0:22769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b48dc6000/0x5757cd208ac38639 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841373.931598:0:22769:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.107@tcp lock: ffffa04b48dc6000/0x5757cd208ac38639 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841373.931609:0:22769:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.107@tcp lock: ffffa04b48dc6000/0x5757cd208ac38639 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841373.931638:0:22769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fb85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413543168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788841373.931720:0:22769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841373.931771:0:22769:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b7d0f7480 going to sleep for 11 seconds 00000100:00100000:2.0:1788841373.931867:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413543168 00000100:00100000:2.0:1788841373.931874:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413543168 00000100:00100000:2.0:1788841373.931919:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788841373.931928:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a4696b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+22:22769:x1875735413543168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788841373.931949:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841373.931963:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa04b67bb3800/0x5757cd208ac38640 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5757cd208ac38639 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841373.931986:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa04b67bb3800/0x5757cd208ac38640 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5757cd208ac38639 expref: 23 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841373.931997:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa04b67bb3800/0x5757cd208ac38640 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5757cd208ac38639 expref: 23 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841373.932005:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04b67bb3800, rc 0) 00000100:00100000:2.0:1788841373.932054:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a4696b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+23:22769:x1875735413543168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841373.932061:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788841373.932292:0:22769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fb85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413543168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788841373.932308:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.107@tcp lock: ffffa04b48dc6000/0x5757cd208ac38639 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac38640 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841373.932316:0:22769:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.107@tcp lock: ffffa04b48dc6000/0x5757cd208ac38639 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5757cd208ac38640 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841373.932375:0:22769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fb85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413543296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788841373.932424:0:22769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841373.932458:0:22769:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b7d0f7480 going to sleep for 11 seconds 00000100:00100000:2.0:1788841373.932547:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413543296 00000100:00100000:2.0:1788841373.932552:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413543296 00000100:00100000:2.0:1788841373.932582:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788841373.932589:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a4696bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+23:22769:x1875735413543296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788841373.932682:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a4696bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+23:22769:x1875735413543296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 93us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841373.932688:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788841373.932750:0:22769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fb85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413543296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788841373.932776:0:22769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fb85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413543424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788841373.932812:0:22769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841373.932829:0:22769:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b7d0f7480 going to sleep for 11 seconds 00000100:00100000:2.0:1788841373.932896:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413543424 00000100:00100000:2.0:1788841373.932901:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413543424 00000100:00100000:2.0:1788841373.932928:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788841373.932935:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a4696a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+23:22769:x1875735413543424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788841373.933010:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a4696a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+23:22769:x1875735413543424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841373.933025:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788841373.933199:0:22769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fb85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413543424:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788841373.936405:0:25812:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788841373.943711:0:22769:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788841373.943760:0:22769:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.107@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788841373.943775:0:22769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b48dc6000/0x5757cd208ac38639 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac38640 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841373.943791:0:22769:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.107@tcp lock: ffffa04b48dc6000/0x5757cd208ac38639 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac38640 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788841373.943804:0:22769:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788841373.943808:0:22769:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa04a45f80000 from 13 10000000:01000000:1.0:1788841373.943812:0:22769:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788841373.943947:0:22769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b48dc7600/0x5757cd208ac38647 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841373.943957:0:22769:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.107@tcp lock: ffffa04b48dc7600/0x5757cd208ac38647 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841373.943968:0:22769:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.107@tcp lock: ffffa04b48dc7600/0x5757cd208ac38647 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841373.944000:0:22769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fb85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413543552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788841373.944153:0:22769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841373.944244:0:22769:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b7d0f7480 going to sleep for 11 seconds 00000100:00100000:2.0:1788841373.946129:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413543552 00000100:00100000:2.0:1788841373.946141:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413543552 00000100:00100000:2.0:1788841373.946236:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788841373.946247:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a46968c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+23:22769:x1875735413543552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788841373.946264:0:22767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841373.946280:0:22767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa04b67bb2a00/0x5757cd208ac3864e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5757cd208ac38647 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841373.946308:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa04b67bb2a00/0x5757cd208ac3864e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5757cd208ac38647 expref: 24 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841373.946320:0:22767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa04b67bb2a00/0x5757cd208ac3864e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5757cd208ac38647 expref: 24 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841373.946329:0:22767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04b67bb2a00, rc 0) 00000100:00100000:2.0:1788841373.946414:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a46968c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a456da20-a415-4617-896c-ee7aa5e4c089+24:22769:x1875735413543552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (2260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841373.946421:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788841373.946501:0:22769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fb85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413543552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788841373.946520:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.107@tcp lock: ffffa04b48dc7600/0x5757cd208ac38647 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac3864e expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841373.946529:0:22769:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.107@tcp lock: ffffa04b48dc7600/0x5757cd208ac38647 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5757cd208ac3864e expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841373.946621:0:22769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b41325500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413543680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788841373.946653:0:22769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841373.952189:0:22769:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04a47a81900 going to sleep for 11 seconds 00000100:00100000:1.0:1788841373.956905:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413543680 00000100:00100000:1.0:1788841373.956921:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413543680 00000100:00100000:1.0:1788841373.956996:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788841373.957007:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a46969050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+24:22769:x1875735413543680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788841373.957274:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a46969050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+24:22769:x1875735413543680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 268us (10618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841373.957282:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788841373.960812:0:22769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b41325500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413543680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788841373.960910:0:22769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b41325500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413543808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788841373.961002:0:22769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841373.961053:0:22769:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04a47a81900 going to sleep for 11 seconds 00000100:00100000:1.0:1788841373.961140:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413543808 00000100:00100000:1.0:1788841373.961147:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413543808 00000100:00100000:1.0:1788841373.961208:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788841373.961218:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a4696b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+24:22769:x1875735413543808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788841373.961341:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a4696b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+24:22769:x1875735413543808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 125us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841373.961349:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788841373.961559:0:22769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b41325500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a456da20-a415-4617-896c-ee7aa5e4c089:22769:1875735413543808:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788841373.962655:0:25813:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788841373.962964:0:22769:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788841373.962987:0:22769:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.107@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788841373.962998:0:22769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.107@tcp lock: ffffa04b48dc7600/0x5757cd208ac38647 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac3864e expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841373.963010:0:22769:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.107@tcp lock: ffffa04b48dc7600/0x5757cd208ac38647 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5757cd208ac3864e expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788841373.966696:0:23525:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788841374.029066:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788841374.221156:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7fb85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875735413543936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788841374.221252:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841374.221422:0:24282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413543936 00000100:00100000:1.0:1788841374.221430:0:24282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413543936 00000100:00100000:1.0:1788841374.221499:0:24282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788841374.221510:0:24282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7f88ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875735413543936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788841374.221559:0:24282:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788841374.221608:0:24282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7f88ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875735413543936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841374.221615:0:24282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1788841374.221726:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788841374.221766:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7fb85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875735413543936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788841374.222249:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7f88dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875735413544192:0@lo:400:kworker.0 00000100:00100000:0.0:1788841374.222282:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841374.222313:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7cb84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875735413544704:0@lo:400:kworker.0 00000100:00100000:0.0:1788841374.222335:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841374.222348:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7cb87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1875735413545216:0@lo:400:kworker.0 00000100:00100000:0.0:1788841374.222392:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841374.222413:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788841374.222417:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7f88f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875735413544320:0@lo:400:kworker.0 00000100:00100000:0.0:1788841374.222449:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841374.222466:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7cb86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875735413544832:0@lo:400:kworker.0 00000100:00100000:0.0:1788841374.222483:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841374.222496:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7cb86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875735413545344:0@lo:400:kworker.0 00000100:00100000:0.0:1788841374.222511:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841374.222534:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413545216 00000100:00100000:0.0:1788841374.222538:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413545216 00000100:00100000:0.0:1788841374.222569:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413544320 00000100:00100000:0.0:1788841374.222572:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413544320 00000100:00100000:0.0:1788841374.222581:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413544832 00000100:00100000:0.0:1788841374.222582:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413544832 00000100:00100000:0.0:1788841374.222591:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413545344 00000100:00100000:0.0:1788841374.222594:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413545344 00000100:00100000:0.0:1788841374.222607:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788841374.222613:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7cb86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875735413545216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841374.222649:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7cb86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875735413545216:12345-0@lo:400:kworker.0 Request processed in 36us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841374.222655:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788841374.222671:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788841374.222677:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7cb85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875735413544320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841374.222703:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7cb85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875735413544320:12345-0@lo:400:kworker.0 Request processed in 26us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841374.222709:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788841374.222720:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788841374.222732:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7cb84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875735413544832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841374.222760:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7cb84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875735413544832:12345-0@lo:400:kworker.0 Request processed in 29us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841374.222766:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788841374.222779:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788841374.222785:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7cb85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875735413545344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841374.222811:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7cb85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875735413545344:12345-0@lo:400:kworker.0 Request processed in 27us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841374.222817:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1788841374.222952:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788841374.222956:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788841374.222965:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7cb87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875735413544448:0@lo:400:kworker.0 00000100:00100000:0.0:1788841374.222994:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841374.223011:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7cb84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875735413544960:0@lo:400:kworker.0 00000100:00100000:0.0:1788841374.223031:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841374.223046:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788841374.223052:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7f88ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875735413544064:0@lo:400:kworker.0 00000100:00100000:0.0:1788841374.223071:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841374.223086:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7cb87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875735413544576:0@lo:400:kworker.0 00000100:00100000:0.0:1788841374.223104:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841374.223117:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7cb85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1875735413545088:0@lo:400:kworker.0 00000100:00100000:0.0:1788841374.223150:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841374.223177:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413544448 00000100:00100000:0.0:1788841374.223181:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413544448 00000100:00100000:0.0:1788841374.223202:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413544064 00000100:00100000:0.0:1788841374.223204:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413544064 00000100:00100000:0.0:1788841374.223229:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788841374.223235:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7cb84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875735413544448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841374.223275:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7cb84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875735413544448:12345-0@lo:400:kworker.0 Request processed in 40us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841374.223280:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788841374.223292:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788841374.223297:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7cb87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875735413544064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841374.223323:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7cb87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875735413544064:12345-0@lo:400:kworker.0 Request processed in 26us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841374.223329:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788841374.223345:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413544960 00000100:00100000:0.0:1788841374.223349:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413544960 00000100:00100000:3.0:1788841374.225098:0:24279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413544192 00000100:00100000:3.0:1788841374.225110:0:24279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413544192 00000100:00100000:3.0:1788841374.225159:0:24279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413544704 00000100:00100000:3.0:1788841374.225162:0:24279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413544704 00000100:00100000:3.0:1788841374.225175:0:24279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413544576 00000100:00100000:3.0:1788841374.225178:0:24279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413544576 00000100:00100000:3.0:1788841374.225191:0:24279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788841374.225209:0:24279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7cb84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875735413544192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841374.225283:0:24279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7cb84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875735413544192:12345-0@lo:400:kworker.0 Request processed in 85us (3000us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841374.225290:0:24279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788841374.225304:0:24279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788841374.225319:0:24279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7cb85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875735413544704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841374.225343:0:24279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7cb85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875735413544704:12345-0@lo:400:kworker.0 Request processed in 34us (3007us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841374.225364:0:24279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788841374.225385:0:24279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788841374.225391:0:24279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7cb86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875735413544576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841374.225416:0:24279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7cb86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875735413544576:12345-0@lo:400:kworker.0 Request processed in 25us (2311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841374.225421:0:24279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788841374.225708:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7f88f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875735413544320:0@lo:400:kworker.0 00000100:00100000:3.0:1788841374.225722:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7cb86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875735413544832:0@lo:400:kworker.0 00010000:00080000:3.0:1788841374.225737:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa04b7cb86a00 x1875735413545344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841374.225748:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7cb86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875735413545344:0@lo:400:kworker.0 00000100:00100000:3.0:1788841374.225759:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7f88dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875735413544192:0@lo:400:kworker.0 00000100:00100000:3.0:1788841374.225770:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7cb84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875735413544704:0@lo:400:kworker.0 00000100:00100000:3.0:1788841374.225782:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7cb87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1875735413545216:0@lo:400:kworker.0 00000100:00100000:2.0:1788841374.226095:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788841374.226107:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7f84e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875735413545472:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788841374.226144:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841374.226175:0:24282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413545472 00000100:00100000:2.0:1788841374.226178:0:24282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413545472 00000100:00100000:2.0:1788841374.226212:0:24282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788841374.226219:0:24282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7f84d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875735413545472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788841374.226242:0:24282:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788841374.226279:0:24282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7f84d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875735413545472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841374.226285:0:24282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788841374.226325:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7f84e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875735413545472:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788841374.226357:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7f88ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875735413544064:0@lo:400:kworker.0 00000100:00100000:2.0:1788841374.226366:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7cb87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875735413544576:0@lo:400:kworker.0 00000100:00100000:2.0:1788841374.226388:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7cb87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875735413544448:0@lo:400:kworker.0 00000100:00100000:0.0:1788841374.227117:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413545088 00000100:00100000:0.0:1788841374.227125:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413545088 00000100:00080000:2.0:1788841374.227224:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788841374.227230:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788841374.227233:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788841374.227235:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788841374.227309:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788841374.227321:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7cb85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875735413544960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841374.227407:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7cb85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875735413544960:12345-0@lo:400:kworker.0 Request processed in 89us (4375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841374.227414:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788841374.227433:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788841374.227448:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6d9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875735413545088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788841374.227495:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6d9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875735413545088:12345-0@lo:400:kworker.0 Request processed in 56us (4345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841374.227501:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:3.0:1788841374.227545:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa04b7cb85f80 x1875735413545088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788841374.227559:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7cb85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1875735413545088:0@lo:400:kworker.0 00000100:00100000:3.0:1788841374.227572:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7cb84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875735413544960:0@lo:400:kworker.0 00000100:00100000:2.0:1788841374.495094:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:1.0:1788841374.495777:0:25016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392449920 00000100:00100000:1.0:1788841374.495791:0:25016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392449920 00000100:00100000:1.0:1788841374.495907:0:25016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 23 00000100:00100000:1.0:1788841374.495921:0:25016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7f84e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fbb75a7f-409e-496d-8433-a98f63f91f81+6:18780:x1875735392449920:12345-192.168.204.7@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788841374.495944:0:25016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788841374.495974:0:25016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6a00/0x5757cd208ac38655 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x56167be89bd53b07 expref: -99 pid: 25016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.503293:0:25016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6600/0x5757cd208ac3865c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.503319:0:25016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6600/0x5757cd208ac3865c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.503334:0:25016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6600/0x5757cd208ac3865c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.503351:0:25016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc7200/0x5757cd208ac38663 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.503359:0:25016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc7200/0x5757cd208ac38663 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.503366:0:25016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc7200/0x5757cd208ac38663 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788841374.503674:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788841374.503817:0:25016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc7000/0x5757cd208ac3866a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.503827:0:25016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc7000/0x5757cd208ac3866a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.503855:0:25016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc7000/0x5757cd208ac3866a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788841374.503892:0:25016:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788841374.503896:0:25016:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788841374.503937:0:25016:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc7000/0x5757cd208ac3866a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.503948:0:25016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6600/0x5757cd208ac3865c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.503956:0:25016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6600/0x5757cd208ac3865c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.503964:0:25016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6600/0x5757cd208ac3865c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.503971:0:25016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b48dc6600 already unused, calling callback (ffffffffc17b44f0) 00010000:00010000:1.0:1788841374.503976:0:25016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6600/0x5757cd208ac3865c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.503986:0:25016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6600/0x5757cd208ac3865c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.503999:0:25016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa04b7f760c00) 00010000:00010000:1.0:1788841374.504009:0:25016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788841374.504015:0:25016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6600/0x5757cd208ac3865c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.504022:0:25016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6600/0x5757cd208ac3865c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.504040:0:25016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc7200/0x5757cd208ac38663 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.504047:0:25016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc7200/0x5757cd208ac38663 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.504053:0:25016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc7200/0x5757cd208ac38663 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.504058:0:25016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b48dc7200 already unused, calling callback (ffffffffc17b44f0) 00010000:00010000:1.0:1788841374.504061:0:25016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc7200/0x5757cd208ac38663 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.504067:0:25016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc7200/0x5757cd208ac38663 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.504074:0:25016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffffa04b7fbbcb00) 00010000:00010000:1.0:1788841374.504077:0:25016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788841374.504080:0:25016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc7200/0x5757cd208ac38663 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.504798:0:25016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc7200/0x5757cd208ac38663 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.504949:0:25016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6a00/0x5757cd208ac38655 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b07 expref: 8 pid: 25016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.504981:0:25016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc7000/0x5757cd208ac3866a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b07 expref: 7 pid: 25016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.504988:0:25016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa04b7fbbc700) 00010000:00010000:1.0:1788841374.504991:0:25016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788841374.504994:0:25016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04b48dc7000, rc 0) 00000100:00100000:1.0:1788841374.505096:0:25016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7f84e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fbb75a7f-409e-496d-8433-a98f63f91f81+7:18780:x1875735392449920:12345-192.168.204.7@tcp:101:lhsmtool_posix.0 Request processed in 9167us (10251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841374.505105:0:25016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 23 00000100:00100000:2.0:1788841374.513104:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:1.0:1788841374.514493:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392450048 00000100:00100000:1.0:1788841374.514507:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392450048 00000100:00100000:1.0:1788841374.514573:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 5 00000100:00100000:1.0:1788841374.514583:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7f84ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fbb75a7f-409e-496d-8433-a98f63f91f81+7:18780:x1875735392450048:12345-192.168.204.7@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788841374.514699:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7f84ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fbb75a7f-409e-496d-8433-a98f63f91f81+7:18780:x1875735392450048:12345-192.168.204.7@tcp:900:lhsmtool_posix.0 Request processed in 116us (1613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841374.514707:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 5 00000100:00100000:0.0:1788841374.526097:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:2.0:1788841374.526218:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392450304 00000100:00100000:2.0:1788841374.526229:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392450304 00000100:00100000:2.0:1788841374.526331:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 24 00000100:00100000:2.0:1788841374.526344:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6d9f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fbb75a7f-409e-496d-8433-a98f63f91f81+7:18780:x1875735392450304:12345-192.168.204.7@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788841374.526381:0:22772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841374.526405:0:22772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3a00/0x5757cd208ac38671 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x56167be89bd53b0e expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.526494:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac38678 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.526526:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac38678 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.526539:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac38678 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.526557:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3c00/0x5757cd208ac3867f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.526564:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3c00/0x5757cd208ac3867f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.526571:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3c00/0x5757cd208ac3867f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.526766:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2200/0x5757cd208ac38686 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.526775:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2200/0x5757cd208ac38686 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.526782:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2200/0x5757cd208ac38686 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788841374.526792:0:22772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788841374.527029:0:22772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac38678 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.527037:0:22772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac38678 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.527044:0:22772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac38678 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.527055:0:22772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b67bb2600 already unused, calling callback (ffffffffc17b44f0) 00010000:00010000:2.0:1788841374.527060:0:22772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac38678 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.527067:0:22772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac38678 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.527079:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa04b7fbbc700) 00010000:00010000:2.0:1788841374.527082:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788841374.527087:0:22772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac38678 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.527094:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac38678 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.527109:0:22772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3c00/0x5757cd208ac3867f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.527115:0:22772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3c00/0x5757cd208ac3867f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.527121:0:22772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3c00/0x5757cd208ac3867f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.527126:0:22772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b67bb3c00 already unused, calling callback (ffffffffc17b44f0) 00010000:00010000:2.0:1788841374.527129:0:22772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3c00/0x5757cd208ac3867f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.527135:0:22772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3c00/0x5757cd208ac3867f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.527153:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffffa04a47b30f00) 00010000:00010000:2.0:1788841374.527156:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788841374.527159:0:22772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3c00/0x5757cd208ac3867f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.527165:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3c00/0x5757cd208ac3867f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.528950:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3a00/0x5757cd208ac38671 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b0e expref: 10 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.528980:0:22772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2200/0x5757cd208ac38686 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b0e expref: 9 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.528988:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa04a47b30000) 00010000:00010000:2.0:1788841374.528991:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788841374.529101:0:22772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04b67bb2200, rc 0) 00000100:00100000:0.0:1788841374.529438:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6d9f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fbb75a7f-409e-496d-8433-a98f63f91f81+9:18780:x1875735392450304:12345-192.168.204.7@tcp:101:lhsmtool_posix.0 Request processed in 3095us (3350us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1788841374.529447:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 24 00000100:00100000:3.0:1788841374.535893:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:0.0:1788841374.535964:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392450432 00000100:00100000:0.0:1788841374.535980:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392450432 00000100:00100000:0.0:1788841374.536174:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 25 00000100:00100000:0.0:1788841374.536186:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b41325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fbb75a7f-409e-496d-8433-a98f63f91f81+9:18780:x1875735392450432:12345-192.168.204.7@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788841374.536337:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b41325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fbb75a7f-409e-496d-8433-a98f63f91f81+9:18780:x1875735392450432:12345-192.168.204.7@tcp:59:lhsmtool_posix.0 Request processed in 152us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841374.536344:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 25 00000100:00100000:2.0:1788841374.546604:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:0.0:1788841374.547721:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392450560 00000100:00100000:0.0:1788841374.547738:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392450560 00000100:00080000:2.0:1788841374.548496:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788841374.548555:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 26 00000100:00100000:0.0:1788841374.548572:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7f84d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fbb75a7f-409e-496d-8433-a98f63f91f81+5:18780:x1875735392450560:12345-192.168.204.7@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788841374.554345:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000004:00080000:0.0:1788841374.554641:0:22773:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 6023us 00000100:00100000:0.0:1788841374.554685:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392450688 00000100:00100000:0.0:1788841374.554695:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392450688 00000100:00100000:0.0:1788841374.554765:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 161 00000100:00100000:0.0:1788841374.554777:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04a46968850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25ddc60b-4cfa-4441-9231-3253d5543004+11:18159:x1875735392450688:12345-192.168.204.7@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788841374.554796:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841374.554817:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa04a4750b400/0x5757cd208ac38694 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x56167be89bd53b15 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841374.554891:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa04a4750b400/0x5757cd208ac38694 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b15 expref: 12 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841374.554905:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa04a4750b400/0x5757cd208ac38694 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b15 expref: 12 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841374.554915:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04a4750b400, rc 0) 00000100:00100000:0.0:1788841374.554980:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04a46968850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25ddc60b-4cfa-4441-9231-3253d5543004+12:18159:x1875735392450688:12345-192.168.204.7@tcp:101:ll_cfg_requeue.0 Request processed in 206us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841374.554986:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 161 00000100:00100000:2.0:1788841374.560072:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:2.0:1788841374.560114:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:1.0:1788841374.560197:0:25016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392450816 00000100:00100000:1.0:1788841374.560207:0:25016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392450816 00000100:00100000:1.0:1788841374.560280:0:25016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 27 00000100:00100000:1.0:1788841374.560300:0:25016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7f84df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fbb75a7f-409e-496d-8433-a98f63f91f81+9:18786:x1875735392450816:12345-192.168.204.7@tcp:101:lfs.0 00010000:00010000:1.0:1788841374.560327:0:25016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788841374.560357:0:25016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6a00/0x5757cd208ac3869b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x56167be89bd53b1c expref: -99 pid: 25016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.560444:0:25016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc7200/0x5757cd208ac386a2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841374.560467:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392450944 00010000:00010000:1.0:1788841374.560477:0:25016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc7200/0x5757cd208ac386a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841374.560482:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392450944 00010000:00010000:1.0:1788841374.560497:0:25016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc7200/0x5757cd208ac386a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.560539:0:25016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6600/0x5757cd208ac386a9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.560548:0:25016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6600/0x5757cd208ac386a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841374.560558:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 162 00010000:00010000:1.0:1788841374.560561:0:25016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6600/0x5757cd208ac386a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841374.560574:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7060d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25ddc60b-4cfa-4441-9231-3253d5543004+12:18159:x1875735392450944:12345-192.168.204.7@tcp:501:ll_cfg_requeue.0 00010000:00010000:1.0:1788841374.560609:0:25016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc7200/0x5757cd208ac386a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.560619:0:25016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc7200/0x5757cd208ac386a2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.560626:0:25016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc7200/0x5757cd208ac386a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.560631:0:25016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b48dc7200 already unused, calling callback (ffffffffc17b44f0) 00010000:00010000:1.0:1788841374.560636:0:25016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc7200/0x5757cd208ac386a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.560643:0:25016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc7200/0x5757cd208ac386a2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.560655:0:25016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa04b7f760c00) 00010000:00010000:1.0:1788841374.560664:0:25016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788841374.560670:0:25016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc7200/0x5757cd208ac386a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.560676:0:25016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc7200/0x5757cd208ac386a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.560691:0:25016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6600/0x5757cd208ac386a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.560697:0:25016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6600/0x5757cd208ac386a9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.560703:0:25016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6600/0x5757cd208ac386a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.560708:0:25016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b48dc6600 already unused, calling callback (ffffffffc17b44f0) 00010000:00010000:1.0:1788841374.560711:0:25016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6600/0x5757cd208ac386a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.560717:0:25016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6600/0x5757cd208ac386a9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.560724:0:25016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffffa04b7fbbcb00) 00010000:00010000:1.0:1788841374.560727:0:25016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788841374.560729:0:25016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6600/0x5757cd208ac386a9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.560736:0:25016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6600/0x5757cd208ac386a9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.560769:0:25016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6a00/0x5757cd208ac3869b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b1c expref: 10 pid: 25016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.560787:0:25016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa04b7f760c00) 00010000:00010000:1.0:1788841374.560789:0:25016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788841374.560793:0:25016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6a00/0x5757cd208ac3869b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b1c expref: 10 pid: 25016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.560803:0:25016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04b48dc6a00, rc 0) 00000100:00100000:1.0:1788841374.560909:0:25016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7f84df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fbb75a7f-409e-496d-8433-a98f63f91f81+9:18786:x1875735392450816:12345-192.168.204.7@tcp:101:lfs.0 Request processed in 610us (848us total) trans 0 rc 301/301 00000100:00100000:1.0:1788841374.560919:0:25016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 27 00000100:00100000:3.0:1788841374.560999:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7060d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25ddc60b-4cfa-4441-9231-3253d5543004+12:18159:x1875735392450944:12345-192.168.204.7@tcp:501:ll_cfg_requeue.0 Request processed in 427us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841374.561009:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 162 00000100:00100000:2.0:1788841374.564588:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:3.0:1788841374.564789:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392451072 00000100:00100000:3.0:1788841374.564803:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392451072 00000100:00100000:3.0:1788841374.564921:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 163 00000100:00100000:3.0:1788841374.564934:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7060e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25ddc60b-4cfa-4441-9231-3253d5543004+12:18159:x1875735392451072:12345-192.168.204.7@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788841374.565147:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7060e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25ddc60b-4cfa-4441-9231-3253d5543004+12:18159:x1875735392451072:12345-192.168.204.7@tcp:503:ll_cfg_requeue.0 Request processed in 215us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841374.565155:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 163 00000100:00100000:2.0:1788841374.567821:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:1.0:1788841374.567950:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392451200 00000100:00100000:1.0:1788841374.567969:0:22781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392451200 00000100:00100000:1.0:1788841374.568061:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 0 00000100:00100000:1.0:1788841374.568076:0:22781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7f84ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:fbb75a7f-409e-496d-8433-a98f63f91f81+9:18786:x1875735392451200:12345-192.168.204.7@tcp:700:lfs.0 00000100:00100000:1.0:1788841374.568174:0:22781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7f84ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:fbb75a7f-409e-496d-8433-a98f63f91f81+9:18786:x1875735392451200:12345-192.168.204.7@tcp:700:lfs.0 Request processed in 102us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841374.568181:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 0 00000100:00100000:2.0:1788841374.571266:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:1.0:1788841374.571530:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392451456 00000100:00100000:1.0:1788841374.571543:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392451456 00000100:00100000:1.0:1788841374.571637:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 28 00000100:00100000:1.0:1788841374.571650:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7f84f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fbb75a7f-409e-496d-8433-a98f63f91f81+9:18786:x1875735392451456:12345-192.168.204.7@tcp:36:lfs.0 00010000:00010000:0.0:1788841374.571921:0:22772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788841374.571971:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750a400/0x5757cd208ac385d0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53a90 expref: 9 pid: 25016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841374.571998:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa04b7f760c00) 00010000:00010000:0.0:1788841374.572005:0:22772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788841374.572125:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750ac00/0x5757cd208ac386b0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841374.572145:0:22772:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3400/0x5757cd208ac3860f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b00 expref: 5 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841374.572155:0:22772:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750ac00/0x5757cd208ac386b0 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841374.572205:0:22772:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3400/0x5757cd208ac3860f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b00 expref: 5 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841374.572225:0:22772:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3400/0x5757cd208ac3860f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b00 expref: 5 pid: 22773 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841374.572242:0:22772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6d9f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22772:1875735413545600:192.168.204.7@tcp:104: 00000100:00100000:0.0:1788841374.572734:0:22772:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b6d4cf780 going to sleep for 11 seconds 00000100:00100000:1.0:1788841374.574477:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:2.0:1788841374.574597:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392451584 00000100:00100000:2.0:1788841374.574609:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392451584 00000100:00100000:2.0:1788841374.574687:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 164 00000100:00100000:2.0:1788841374.574721:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7060cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25ddc60b-4cfa-4441-9231-3253d5543004+12:18159:x1875735392451584:12345-192.168.204.7@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788841374.574749:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841374.574772:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa04b67bb3200/0x5757cd208ac386b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x56167be89bd53b23 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.574808:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa04b67bb3200/0x5757cd208ac386b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b23 expref: 13 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.574822:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa04b67bb3200/0x5757cd208ac386b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b23 expref: 13 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.574855:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04b67bb3200, rc 0) 00000100:00100000:2.0:1788841374.574929:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7060cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25ddc60b-4cfa-4441-9231-3253d5543004+13:18159:x1875735392451584:12345-192.168.204.7@tcp:101:ll_cfg_requeue.0 Request processed in 213us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841374.574936:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 164 00000100:00100000:2.0:1788841374.578166:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:1.0:1788841374.578356:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392451712 00000100:00100000:1.0:1788841374.578379:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392451712 00010000:00010000:1.0:1788841374.578466:0:22759:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3400/0x5757cd208ac3860f lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b00 expref: 6 pid: 22773 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841374.578542:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 15 00000100:00100000:1.0:1788841374.578556:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7f84c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+6:2400:x1875735392451712:12345-192.168.204.7@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788841374.578593:0:22759:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788841374.578604:0:22759:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3400/0x5757cd208ac3860f lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b00 expref: 6 pid: 22773 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.578622:0:22759:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3400/0x5757cd208ac3860f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b00 expref: 6 pid: 22773 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.578656:0:22759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa04b7f760c00) 00010000:00010000:1.0:1788841374.578662:0:22759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750ac00/0x5757cd208ac386b0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.578674:0:22759:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750ac00/0x5757cd208ac386b0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.578684:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750ac00/0x5757cd208ac386b0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.578711:0:22759:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788841374.578784:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7f84c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+6:2400:x1875735392451712:12345-192.168.204.7@tcp:103:ldlm_bl.0 Request processed in 230us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841374.578793:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 15 00010000:00010000:3.0:1788841374.579174:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3400/0x5757cd208ac3860f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b00 expref: 5 pid: 22773 timeout: 908 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841374.579215:0:22772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6d9f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22772:1875735413545600:192.168.204.7@tcp:104: 00010000:00010000:3.0:1788841374.579245:0:22772:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750ac00/0x5757cd208ac386b0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841374.579255:0:22772:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750ac00/0x5757cd208ac386b0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841374.579261:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750ac00/0x5757cd208ac386b0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788841374.579393:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788841374.580085:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4800/0x5757cd208ac386be lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841374.580104:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4800/0x5757cd208ac386be lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841374.580117:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4800/0x5757cd208ac386be lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841374.581199:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:0.0:1788841374.581300:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392451840 00000100:00100000:0.0:1788841374.581315:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392451840 00000100:00100000:0.0:1788841374.581400:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 165 00000100:00100000:0.0:1788841374.581412:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7060c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25ddc60b-4cfa-4441-9231-3253d5543004+13:18159:x1875735392451840:12345-192.168.204.7@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788841374.581628:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7060c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25ddc60b-4cfa-4441-9231-3253d5543004+13:18159:x1875735392451840:12345-192.168.204.7@tcp:501:ll_cfg_requeue.0 Request processed in 217us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841374.581638:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 165 00000100:00100000:1.0:1788841374.585326:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:1.0:1788841374.585387:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392451968 00000100:00100000:1.0:1788841374.585402:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392451968 00000100:00100000:1.0:1788841374.585492:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 166 00000100:00100000:1.0:1788841374.585503:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7060c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25ddc60b-4cfa-4441-9231-3253d5543004+13:18159:x1875735392451968:12345-192.168.204.7@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788841374.585697:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7060c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25ddc60b-4cfa-4441-9231-3253d5543004+13:18159:x1875735392451968:12345-192.168.204.7@tcp:503:ll_cfg_requeue.0 Request processed in 194us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841374.585706:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 166 00010000:00010000:3.0:1788841374.586914:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c5000/0x5757cd208ac386c5 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841374.587115:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c5000/0x5757cd208ac386c5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841374.587132:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c5000/0x5757cd208ac386c5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788841374.587157:0:22772:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001497d404 reply state 0000000071f5619b transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c5000/0x5757cd208ac386c5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841374.587184:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c5000/0x5757cd208ac386c5 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841374.587193:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa04b558f7000) 00010000:00010000:3.0:1788841374.587197:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788841374.587202:0:22772:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788841374.587211:0:22772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788841374.587222:0:22772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750ac00/0x5757cd208ac386b0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841374.587229:0:22772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750ac00/0x5757cd208ac386b0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841374.587236:0:22772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750ac00/0x5757cd208ac386b0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841374.587242:0:22772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a4750ac00 already unused, calling callback (ffffffffc17b44f0) 00010000:00010000:3.0:1788841374.587247:0:22772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750ac00/0x5757cd208ac386b0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841374.587255:0:22772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750ac00/0x5757cd208ac386b0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841374.587266:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa04b7f760c00) 00010000:00010000:3.0:1788841374.587338:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788841374.587344:0:22772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750ac00/0x5757cd208ac386b0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841374.587351:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750ac00/0x5757cd208ac386b0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788841374.587394:0:22772:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001497d404 reply state 0000000071f5619b transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4800/0x5757cd208ac386be lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841374.587404:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4800/0x5757cd208ac386be lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841374.587411:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffffa04b558f7d00) 00010000:00010000:3.0:1788841374.587413:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788841374.587415:0:22772:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788841374.587617:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7f84f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fbb75a7f-409e-496d-8433-a98f63f91f81+10:18786:x1875735392451456:12345-192.168.204.7@tcp:36:lfs.0 Request processed in 15965us (16361us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1788841374.587626:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 28 00000100:00100000:1.0:1788841374.589286:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7f84d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fbb75a7f-409e-496d-8433-a98f63f91f81+5:18780:x1875735392450560:12345-192.168.204.7@tcp:59:lhsmtool_posix.0 Request processed in 40697us (42676us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841374.589302:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 26 00000100:00100000:1.0:1788841374.691162:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:2.0:1788841374.691347:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392452096 00000100:00100000:2.0:1788841374.691361:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392452096 00000100:00100000:2.0:1788841374.691468:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 29 00000100:00100000:2.0:1788841374.691483:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7fb84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fbb75a7f-409e-496d-8433-a98f63f91f81+10:18796:x1875735392452096:12345-192.168.204.7@tcp:101:lctl.0 00010000:00010000:2.0:1788841374.691524:0:22774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841374.691560:0:22774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2c00/0x5757cd208ac386cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x56167be89bd53b2a expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.691669:0:22774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3400/0x5757cd208ac386d3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.691715:0:22774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3400/0x5757cd208ac386d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.691734:0:22774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3400/0x5757cd208ac386d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788841374.691808:0:22774:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788841374.691814:0:22774:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788841374.691925:0:22774:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3400/0x5757cd208ac386d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.691959:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2c00/0x5757cd208ac386cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b2a expref: 12 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.691982:0:22774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3400/0x5757cd208ac386d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b2a expref: 11 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.691991:0:22774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa04a47b30f00) 00010000:00010000:2.0:1788841374.691995:0:22774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788841374.691999:0:22774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04b67bb3400, rc 0) 00000100:00100000:2.0:1788841374.692077:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7fb84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fbb75a7f-409e-496d-8433-a98f63f91f81+11:18796:x1875735392452096:12345-192.168.204.7@tcp:101:lctl.0 Request processed in 596us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841374.692086:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 29 00000100:00100000:2.0:1788841374.719892:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:3.0:1788841374.721262:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392452224 00000100:00100000:3.0:1788841374.721282:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392452224 00000100:00100000:2.0:1788841374.721614:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 30 00000100:00100000:2.0:1788841374.721629:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6e05d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+5:18797:x1875735392452224:12345-192.168.204.7@tcp:101:lfs.0 00010000:00010000:2.0:1788841374.721670:0:22772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841374.721720:0:22772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2c00/0x5757cd208ac386da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x56167be89bd53b31 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.721830:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2800/0x5757cd208ac386e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.721871:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2800/0x5757cd208ac386e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.721886:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2800/0x5757cd208ac386e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788841374.721953:0:22772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788841374.721957:0:22772:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788841374.721988:0:22772:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2800/0x5757cd208ac386e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.722019:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2c00/0x5757cd208ac386da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b31 expref: 7 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.722042:0:22772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2800/0x5757cd208ac386e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b31 expref: 6 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.722053:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa04a47b30f00) 00010000:00010000:2.0:1788841374.722056:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788841374.722060:0:22772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04b67bb2800, rc 0) 00000100:00100000:2.0:1788841374.722205:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6e05d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+6:18797:x1875735392452224:12345-192.168.204.7@tcp:101:lfs.0 Request processed in 578us (2327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841374.722213:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 30 00000100:00100000:0.0:1788841374.727676:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:2.0:1788841374.727959:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392452352 00000100:00100000:2.0:1788841374.727991:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392452352 00000100:00100000:2.0:1788841374.728132:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 31 00000100:00100000:2.0:1788841374.728146:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6d9f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+6:18797:x1875735392452352:12345-192.168.204.7@tcp:101:lfs.0 00010000:00010000:2.0:1788841374.728176:0:22774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841374.728207:0:22774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3600/0x5757cd208ac386e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x56167be89bd53b38 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.728304:0:22774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2400/0x5757cd208ac386ef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.728325:0:22774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2400/0x5757cd208ac386ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.728341:0:22774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2400/0x5757cd208ac386ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.728353:0:22774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac386f6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.728372:0:22774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac386f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.728380:0:22774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac386f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.728507:0:22774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3a00/0x5757cd208ac386fd lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.728518:0:22774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3a00/0x5757cd208ac386fd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.728525:0:22774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3a00/0x5757cd208ac386fd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788841374.728588:0:22774:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788841374.728593:0:22774:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788841374.728618:0:22774:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3a00/0x5757cd208ac386fd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.728634:0:22774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2400/0x5757cd208ac386ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.728641:0:22774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2400/0x5757cd208ac386ef lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.728649:0:22774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2400/0x5757cd208ac386ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.728656:0:22774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b67bb2400 already unused, calling callback (ffffffffc17b44f0) 00010000:00010000:2.0:1788841374.728661:0:22774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2400/0x5757cd208ac386ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.728670:0:22774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2400/0x5757cd208ac386ef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.728685:0:22774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa04a47b30f00) 00010000:00010000:2.0:1788841374.728689:0:22774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788841374.728695:0:22774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2400/0x5757cd208ac386ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.728702:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2400/0x5757cd208ac386ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.728718:0:22774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac386f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.728735:0:22774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac386f6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.728742:0:22774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac386f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.728748:0:22774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b67bb2600 already unused, calling callback (ffffffffc17b44f0) 00010000:00010000:2.0:1788841374.728751:0:22774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac386f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.728758:0:22774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac386f6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.730670:0:22774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffffa04b558f7d00) 00010000:00010000:2.0:1788841374.730675:0:22774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788841374.730687:0:22774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac386f6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.730696:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac386f6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.731243:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3600/0x5757cd208ac386e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b38 expref: 8 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.731268:0:22774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3a00/0x5757cd208ac386fd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b38 expref: 7 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.731277:0:22774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa04b558f7000) 00010000:00010000:2.0:1788841374.731280:0:22774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788841374.731306:0:22774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04b67bb3a00, rc 0) 00000100:00100000:2.0:1788841374.731413:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6d9f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+7:18797:x1875735392452352:12345-192.168.204.7@tcp:101:lfs.0 Request processed in 3268us (3750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841374.731424:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 31 00000100:00100000:3.0:1788841374.737232:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:1.0:1788841374.737334:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392452480 00000100:00100000:1.0:1788841374.737348:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392452480 00000100:00100000:1.0:1788841374.737469:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 6 00000100:00100000:1.0:1788841374.737483:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b41324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+5:18797:x1875735392452480:12345-192.168.204.7@tcp:900:lfs.0 00000100:00080000:2.0:1788841374.737801:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788841374.737865:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b41324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+5:18797:x1875735392452480:12345-192.168.204.7@tcp:900:lfs.0 Request processed in 385us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841374.737881:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 6 00000100:00100000:0.0:1788841374.745642:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:1.0:1788841374.745804:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392452736 00000100:00100000:1.0:1788841374.745820:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392452736 00000100:00100000:1.0:1788841374.746050:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 32 00000100:00100000:1.0:1788841374.746063:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6d9f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+7:18797:x1875735392452736:12345-192.168.204.7@tcp:101:lfs.0 00010000:00010000:1.0:1788841374.746094:0:22773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788841374.746120:0:22773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc7200/0x5757cd208ac38704 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x56167be89bd53b3f expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788841374.746283:0:22773:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788841374.749896:0:22773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc7200/0x5757cd208ac38704 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b3f expref: 9 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.749968:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa04a47b30f00) 00010000:00010000:1.0:1788841374.749972:0:22773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788841374.749979:0:22773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc7200/0x5757cd208ac38704 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b3f expref: 9 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.750005:0:22773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04b48dc7200, rc 0) 00000100:00100000:1.0:1788841374.750130:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6d9f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+8:18797:x1875735392452736:12345-192.168.204.7@tcp:101:lfs.0 Request processed in 4067us (4502us total) trans 12884901891 rc 301/301 00000100:00100000:1.0:1788841374.750141:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 32 00000100:00100000:3.0:1788841374.763490:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:1.0:1788841374.763711:0:25016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392452992 00000100:00100000:1.0:1788841374.763726:0:25016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392452992 00000100:00100000:1.0:1788841374.763811:0:25016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 33 00000100:00100000:1.0:1788841374.763824:0:25016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b41325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+8:18797:x1875735392452992:12345-192.168.204.7@tcp:36:lfs.0 00010000:00010000:1.0:1788841374.763958:0:25016:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788841374.764001:0:25016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3a00/0x5757cd208ac386fd lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b38 expref: 8 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.764027:0:25016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa04b558f7000) 00010000:00010000:1.0:1788841374.764033:0:25016:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788841374.764064:0:25016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc7200/0x5757cd208ac38712 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.764081:0:25016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc7200/0x5757cd208ac38712 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.764097:0:25016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc7200/0x5757cd208ac38712 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788841374.764395:0:25016:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e2f7a84a reply state 000000006871cd11 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc7200/0x5757cd208ac38712 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.764411:0:25016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc7200/0x5757cd208ac38712 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.764417:0:25016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa04b558f7000) 00010000:00010000:1.0:1788841374.764419:0:25016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1788841374.764422:0:25016:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788841374.764440:0:25016:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788841374.764553:0:25016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b41325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+9:18797:x1875735392452992:12345-192.168.204.7@tcp:36:lfs.0 Request processed in 731us (1083us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1788841374.764561:0:25016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 33 00000100:00100000:3.0:1788841374.774589:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:0.0:1788841374.776049:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392453248 00000100:00100000:0.0:1788841374.776068:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392453248 00000100:00100000:0.0:1788841374.776174:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 2 00000100:00100000:0.0:1788841374.776187:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b41327b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+9:18797:x1875735392453248:12345-192.168.204.7@tcp:35:lfs.0 00000100:00100000:0.0:1788841374.778212:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b41327b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+10:18797:x1875735392453248:12345-192.168.204.7@tcp:35:lfs.0 Request processed in 2011us (3623us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1788841374.778229:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 2 00000100:00100000:3.0:1788841374.795409:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:2.0:1788841374.797741:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392453504 00000100:00100000:2.0:1788841374.797777:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392453504 00000100:00100000:2.0:1788841374.797950:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 34 00000100:00100000:2.0:1788841374.797965:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b41325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+10:18797:x1875735392453504:12345-192.168.204.7@tcp:101:lfs.0 00010000:00010000:2.0:1788841374.798005:0:22772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841374.798034:0:22772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3600/0x5757cd208ac38719 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x56167be89bd53b46 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.798138:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac38720 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.798156:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac38720 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.798170:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac38720 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.798182:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2400/0x5757cd208ac38727 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.798191:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2400/0x5757cd208ac38727 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.798198:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2400/0x5757cd208ac38727 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788841374.798377:0:22772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788841374.798631:0:22772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac38720 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.798641:0:22772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac38720 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.798648:0:22772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac38720 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.798655:0:22772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b67bb2600 already unused, calling callback (ffffffffc17b44f0) 00010000:00010000:2.0:1788841374.798660:0:22772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac38720 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.798668:0:22772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac38720 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.798683:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa04a47b30f00) 00010000:00010000:2.0:1788841374.798686:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788841374.798692:0:22772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac38720 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.798698:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac38720 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.798714:0:22772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2400/0x5757cd208ac38727 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.798720:0:22772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2400/0x5757cd208ac38727 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.798736:0:22772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2400/0x5757cd208ac38727 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.798742:0:22772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b67bb2400 already unused, calling callback (ffffffffc17b44f0) 00010000:00010000:2.0:1788841374.798744:0:22772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2400/0x5757cd208ac38727 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.798751:0:22772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2400/0x5757cd208ac38727 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.798760:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffffa04b558f7d00) 00010000:00010000:2.0:1788841374.798763:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788841374.798766:0:22772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2400/0x5757cd208ac38727 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.798771:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2400/0x5757cd208ac38727 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.798810:0:22772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3600/0x5757cd208ac38719 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b46 expref: 12 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.798822:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa04a47b30f00) 00010000:00010000:2.0:1788841374.798825:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788841374.798828:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3600/0x5757cd208ac38719 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b46 expref: 12 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.799093:0:22772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04b67bb3600, rc 0) 00000100:00100000:2.0:1788841374.799187:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b41325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+11:18797:x1875735392453504:12345-192.168.204.7@tcp:101:lfs.0 Request processed in 1224us (3794us total) trans 12884901894 rc 301/301 00000100:00100000:2.0:1788841374.799207:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 34 00000100:00100000:3.0:1788841374.801940:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:2.0:1788841374.802253:0:25016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392453632 00000100:00100000:2.0:1788841374.802267:0:25016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392453632 00000100:00100000:2.0:1788841374.802338:0:25016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 35 00000100:00100000:2.0:1788841374.802352:0:25016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b41326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+11:18797:x1875735392453632:12345-192.168.204.7@tcp:101:lfs.0 00010000:00010000:2.0:1788841374.802400:0:25016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841374.802703:0:25016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2c00/0x5757cd208ac38735 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x56167be89bd53b4d expref: -99 pid: 25016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.803265:0:25016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2400/0x5757cd208ac3873c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.803286:0:25016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2400/0x5757cd208ac3873c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.803299:0:25016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2400/0x5757cd208ac3873c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788841374.803334:0:25016:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788841374.803338:0:25016:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788841374.803374:0:25016:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2400/0x5757cd208ac3873c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.803411:0:25016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2c00/0x5757cd208ac38735 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b4d expref: 13 pid: 25016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.803504:0:25016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2400/0x5757cd208ac3873c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b4d expref: 12 pid: 25016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.803531:0:25016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa04b558f7000) 00010000:00010000:2.0:1788841374.803535:0:25016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788841374.803540:0:25016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04b67bb2400, rc 0) 00000100:00100000:2.0:1788841374.803671:0:25016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b41326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+12:18797:x1875735392453632:12345-192.168.204.7@tcp:101:lfs.0 Request processed in 1319us (1743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841374.803680:0:25016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 35 00000100:00100000:3.0:1788841374.807626:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:2.0:1788841374.807756:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392453760 00000100:00100000:2.0:1788841374.807771:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392453760 00000100:00100000:2.0:1788841374.807902:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 3 00000100:00100000:2.0:1788841374.807917:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b41324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+12:18797:x1875735392453760:12345-192.168.204.7@tcp:37:lfs.0 00000100:00100000:2.0:1788841374.823953:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b41324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+12:18797:x1875735392453760:12345-192.168.204.7@tcp:37:lfs.0 Request processed in 16020us (16323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841374.823971:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 3 00000100:00100000:3.0:1788841374.832208:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:0.0:1788841374.832340:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392454016 00000100:00100000:0.0:1788841374.832356:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392454016 00000100:00100000:0.0:1788841374.832509:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 4 00000100:00100000:0.0:1788841374.832522:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7c1e0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+12:18797:x1875735392454016:12345-192.168.204.7@tcp:35:lfs.0 00000100:00100000:0.0:1788841374.833164:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7c1e0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+13:18797:x1875735392454016:12345-192.168.204.7@tcp:35:lfs.0 Request processed in 639us (967us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1788841374.833176:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 4 00000100:00100000:3.0:1788841374.906552:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:2.0:1788841374.906759:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392454144 00000100:00100000:2.0:1788841374.906776:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392454144 00000100:00100000:2.0:1788841374.906928:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 36 00000100:00100000:2.0:1788841374.906942:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b41327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fbb75a7f-409e-496d-8433-a98f63f91f81+11:18803:x1875735392454144:12345-192.168.204.7@tcp:101:bash.0 00010000:00010000:2.0:1788841374.906969:0:22772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841374.907001:0:22772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3600/0x5757cd208ac38743 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x56167be89bd53b54 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.907116:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac3874a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.907137:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac3874a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.907175:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac3874a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.907190:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3c00/0x5757cd208ac38751 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.907199:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3c00/0x5757cd208ac38751 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.907207:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3c00/0x5757cd208ac38751 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.907313:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3e00/0x5757cd208ac38758 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.907323:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3e00/0x5757cd208ac38758 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.907330:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3e00/0x5757cd208ac38758 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788841374.907391:0:22772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788841374.907396:0:22772:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788841374.907453:0:22772:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3e00/0x5757cd208ac38758 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.907468:0:22772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac3874a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.907476:0:22772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac3874a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.907493:0:22772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac3874a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.907500:0:22772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b67bb2600 already unused, calling callback (ffffffffc17b44f0) 00010000:00010000:2.0:1788841374.907505:0:22772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac3874a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.907515:0:22772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac3874a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.907531:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa04a47b30f00) 00010000:00010000:2.0:1788841374.907535:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788841374.907541:0:22772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac3874a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.907549:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac3874a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.907565:0:22772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3c00/0x5757cd208ac38751 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.907572:0:22772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3c00/0x5757cd208ac38751 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.907578:0:22772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3c00/0x5757cd208ac38751 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.907584:0:22772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b67bb3c00 already unused, calling callback (ffffffffc17b44f0) 00010000:00010000:2.0:1788841374.907586:0:22772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3c00/0x5757cd208ac38751 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.907602:0:22772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3c00/0x5757cd208ac38751 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.907611:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffffa04b558f7d00) 00010000:00010000:2.0:1788841374.907614:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788841374.907617:0:22772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3c00/0x5757cd208ac38751 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.907623:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3c00/0x5757cd208ac38751 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.907656:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3600/0x5757cd208ac38743 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b54 expref: 13 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.907672:0:22772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3e00/0x5757cd208ac38758 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b54 expref: 12 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841374.907679:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa04b558f7000) 00010000:00010000:2.0:1788841374.907682:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788841374.907684:0:22772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04b67bb3e00, rc 0) 00000100:00100000:2.0:1788841374.907769:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b41327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fbb75a7f-409e-496d-8433-a98f63f91f81+12:18803:x1875735392454144:12345-192.168.204.7@tcp:101:bash.0 Request processed in 829us (1236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841374.907777:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 36 00000100:00100000:3.0:1788841374.911327:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:0.0:1788841374.911511:0:22784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392454272 00000100:00100000:0.0:1788841374.911526:0:22784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392454272 00000100:00100000:0.0:1788841374.911653:0:22784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 7 00000100:00100000:0.0:1788841374.911668:0:22784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b41327b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:fbb75a7f-409e-496d-8433-a98f63f91f81+5:18803:x1875735392454272:12345-192.168.204.7@tcp:900:bash.0 00000100:00100000:0.0:1788841374.911814:0:22784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b41327b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:fbb75a7f-409e-496d-8433-a98f63f91f81+5:18803:x1875735392454272:12345-192.168.204.7@tcp:900:bash.0 Request processed in 149us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841374.911824:0:22784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 7 00000100:00100000:2.0:1788841374.917256:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:0.0:1788841374.917378:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392454528 00000100:00100000:0.0:1788841374.917394:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392454528 00000100:00100000:0.0:1788841374.917482:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 37 00000100:00100000:0.0:1788841374.917496:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6e05ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fbb75a7f-409e-496d-8433-a98f63f91f81+12:18803:x1875735392454528:12345-192.168.204.7@tcp:101:bash.0 00010000:00010000:0.0:1788841374.917525:0:22774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841374.917554:0:22774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750bc00/0x5757cd208ac3875f lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x56167be89bd53b5b expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841374.918021:0:22774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750b200/0x5757cd208ac38766 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841374.918043:0:22774:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2400/0x5757cd208ac3873c lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b4d expref: 12 pid: 25016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841374.918054:0:22774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750b200/0x5757cd208ac38766 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841374.918112:0:22774:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2400/0x5757cd208ac3873c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b4d expref: 12 pid: 25016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841374.918132:0:22774:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2400/0x5757cd208ac3873c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b4d expref: 12 pid: 25016 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841374.918148:0:22774:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6d9f0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22774:1875735413545728:192.168.204.7@tcp:104: 00000100:00100000:0.0:1788841374.918271:0:22774:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b6d4cff00 going to sleep for 11 seconds 00000100:00100000:3.0:1788841374.921932:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:1.0:1788841374.921978:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392454656 00000100:00100000:1.0:1788841374.921993:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392454656 00010000:00010000:1.0:1788841374.922057:0:22758:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2400/0x5757cd208ac3873c lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b4d expref: 13 pid: 25016 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841374.922115:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 16 00000100:00100000:1.0:1788841374.922127:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b41324000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+13:2400:x1875735392454656:12345-192.168.204.7@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788841374.922149:0:22758:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788841374.922281:0:22758:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2400/0x5757cd208ac3873c lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b4d expref: 13 pid: 25016 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841374.922289:0:22774:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6d9f0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22774:1875735413545728:192.168.204.7@tcp:104: 00010000:00010000:1.0:1788841374.922300:0:22758:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2400/0x5757cd208ac3873c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b4d expref: 13 pid: 25016 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.922458:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2400/0x5757cd208ac3873c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b4d expref: 13 pid: 25016 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841374.927072:0:22774:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750b200/0x5757cd208ac38766 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.934085:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa04b558f7000) 00010000:00010000:1.0:1788841374.934107:0:22758:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750b200/0x5757cd208ac38766 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.934128:0:22758:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750b200/0x5757cd208ac38766 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.934138:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750b200/0x5757cd208ac38766 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841374.934202:0:22758:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788841374.934416:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b41324000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+12:2400:x1875735392454656:12345-192.168.204.7@tcp:103:ldlm_bl.0 Request processed in 12276us (12488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841374.934428:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 16 00010000:00010000:0.0:1788841374.935210:0:22774:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750b200/0x5757cd208ac38766 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841374.935228:0:22774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750b200/0x5757cd208ac38766 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841374.938132:0:22774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750be00/0x5757cd208ac3876d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841374.938189:0:22774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750be00/0x5757cd208ac3876d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841374.938203:0:22774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750be00/0x5757cd208ac3876d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841374.939495:0:22774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750b800/0x5757cd208ac38774 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841374.939513:0:22774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750b800/0x5757cd208ac38774 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841374.939521:0:22774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750b800/0x5757cd208ac38774 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788841374.939534:0:22774:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788841374.939561:0:22774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750b200/0x5757cd208ac38766 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841374.939568:0:22774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750b200/0x5757cd208ac38766 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841374.939575:0:22774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750b200/0x5757cd208ac38766 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841374.939581:0:22774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a4750b200 already unused, calling callback (ffffffffc17b44f0) 00010000:00010000:0.0:1788841374.939585:0:22774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750b200/0x5757cd208ac38766 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841374.939592:0:22774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750b200/0x5757cd208ac38766 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841374.939620:0:22774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa04b558f7000) 00010000:00010000:0.0:1788841374.939623:0:22774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788841374.939628:0:22774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750b200/0x5757cd208ac38766 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841374.939634:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750b200/0x5757cd208ac38766 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788841374.939647:0:22774:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000746e2e86 reply state 00000000e2a6c984 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750be00/0x5757cd208ac3876d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841374.939656:0:22774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750be00/0x5757cd208ac3876d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841374.939662:0:22774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffffa04a46a6c700) 00010000:00010000:0.0:1788841374.939664:0:22774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788841374.939667:0:22774:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788841374.939703:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750bc00/0x5757cd208ac3875f lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b5b expref: 15 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841374.939717:0:22774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750b800/0x5757cd208ac38774 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b5b expref: 14 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841374.939724:0:22774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa04a46a6ca00) 00010000:00010000:0.0:1788841374.939727:0:22774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788841374.939729:0:22774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04a4750b800, rc 0) 00000100:00100000:0.0:1788841374.940190:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6e05ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fbb75a7f-409e-496d-8433-a98f63f91f81+15:18803:x1875735392454528:12345-192.168.204.7@tcp:101:bash.0 Request processed in 22695us (22949us total) trans 12884901896 rc 0/0 00000100:00100000:0.0:1788841374.940200:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 37 00000100:00100000:2.0:1788841374.971050:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:3.0:1788841374.971153:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392454784 00000100:00100000:3.0:1788841374.971171:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392454784 00000100:00100000:3.0:1788841374.971268:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 38 00000100:00100000:3.0:1788841374.971280:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6e05e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fbb75a7f-409e-496d-8433-a98f63f91f81+15:18803:x1875735392454784:12345-192.168.204.7@tcp:101:bash.0 00010000:00010000:3.0:1788841374.971324:0:22773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788841374.971349:0:22773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4400/0x5757cd208ac38782 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x56167be89bd53b62 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841374.971449:0:22773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4600/0x5757cd208ac38789 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841374.971473:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4600/0x5757cd208ac38789 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841374.971486:0:22773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4600/0x5757cd208ac38789 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788841374.971538:0:22773:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788841374.971542:0:22773:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788841374.971567:0:22773:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4600/0x5757cd208ac38789 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841374.971577:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4600/0x5757cd208ac38789 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841374.971601:0:22773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4400/0x5757cd208ac38782 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b62 expref: 17 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841374.971618:0:22773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4600/0x5757cd208ac38789 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b62 expref: 16 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841374.971626:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa04a46a6ca00) 00010000:00010000:3.0:1788841374.971630:0:22773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788841374.971633:0:22773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04b7f8c4600, rc 0) 00000100:00100000:3.0:1788841374.971727:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6e05e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fbb75a7f-409e-496d-8433-a98f63f91f81+16:18803:x1875735392454784:12345-192.168.204.7@tcp:101:bash.0 Request processed in 448us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841374.971734:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 38 00000100:00100000:0.0:1788841374.975808:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:1.0:1788841374.975950:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392455040 00000100:00100000:1.0:1788841374.975960:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392455040 00000100:00100000:1.0:1788841374.976015:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 5 00000100:00100000:1.0:1788841374.976026:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6d9f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fbb75a7f-409e-496d-8433-a98f63f91f81+16:18803:x1875735392455040:12345-192.168.204.7@tcp:35:bash.0 00000100:00100000:1.0:1788841374.976344:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6d9f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fbb75a7f-409e-496d-8433-a98f63f91f81+17:18803:x1875735392455040:12345-192.168.204.7@tcp:35:bash.0 Request processed in 319us (546us total) trans 12884901897 rc 0/0 00000100:00100000:1.0:1788841374.976354:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 5 00000040:00080000:0.0:1788841374.989812:0:23525:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788841375.053591:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788841375.109194:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:2.0:1788841375.112476:0:25016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392455296 00000100:00100000:2.0:1788841375.112519:0:25016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392455296 00000100:00100000:2.0:1788841375.112634:0:25016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 39 00000100:00100000:2.0:1788841375.112670:0:25016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6d9f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fbb75a7f-409e-496d-8433-a98f63f91f81+17:18813:x1875735392455296:12345-192.168.204.7@tcp:101:lfs.0 00010000:00010000:2.0:1788841375.112710:0:25016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841375.112745:0:25016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3c00/0x5757cd208ac38790 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x56167be89bd53b69 expref: -99 pid: 25016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788841375.112945:0:25016:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788841375.113131:0:25016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3c00/0x5757cd208ac38790 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b69 expref: 19 pid: 25016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841375.113152:0:25016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa04a47b30f00) 00010000:00010000:2.0:1788841375.113156:0:25016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788841375.113164:0:25016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3c00/0x5757cd208ac38790 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b69 expref: 19 pid: 25016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841375.113184:0:25016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04b67bb3c00, rc 0) 00000100:00100000:2.0:1788841375.113289:0:25016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6d9f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fbb75a7f-409e-496d-8433-a98f63f91f81+18:18813:x1875735392455296:12345-192.168.204.7@tcp:101:lfs.0 Request processed in 623us (4110us total) trans 12884901898 rc 301/301 00000100:00100000:2.0:1788841375.113297:0:25016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 39 00000100:00100000:0.0:1788841375.125041:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:1.0:1788841375.125156:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392455552 00000100:00100000:1.0:1788841375.125186:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392455552 00000100:00100000:1.0:1788841375.125284:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 6 00000100:00100000:1.0:1788841375.125297:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6d9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fbb75a7f-409e-496d-8433-a98f63f91f81+18:18813:x1875735392455552:12345-192.168.204.7@tcp:35:lfs.0 00000100:00100000:1.0:1788841375.125623:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6d9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fbb75a7f-409e-496d-8433-a98f63f91f81+19:18813:x1875735392455552:12345-192.168.204.7@tcp:35:lfs.0 Request processed in 328us (600us total) trans 12884901899 rc 0/0 00000100:00100000:1.0:1788841375.125648:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 6 00000100:00100000:3.0:1788841375.204968:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:1.0:1788841375.205987:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392455808 00000100:00100000:1.0:1788841375.206004:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392455808 00000100:00100000:1.0:1788841375.206086:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 40 00000100:00100000:1.0:1788841375.206098:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b41326300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fbb75a7f-409e-496d-8433-a98f63f91f81+19:18816:x1875735392455808:12345-192.168.204.7@tcp:101:lfs.0 00010000:00010000:1.0:1788841375.206125:0:22773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788841375.206147:0:22773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6400/0x5757cd208ac3879e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x56167be89bd53b70 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841375.207650:0:22773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc7c00/0x5757cd208ac387a5 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841375.207675:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc7c00/0x5757cd208ac387a5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841375.207687:0:22773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc7c00/0x5757cd208ac387a5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788841375.207700:0:22773:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788841375.208999:0:22773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6400/0x5757cd208ac3879e lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b70 expref: 22 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841375.209026:0:22773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc7c00/0x5757cd208ac387a5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b70 expref: 21 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841375.209036:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa04a46a6ca00) 00010000:00010000:1.0:1788841375.209039:0:22773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788841375.209043:0:22773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04b48dc7c00, rc 0) 00000100:00100000:1.0:1788841375.209131:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b41326300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fbb75a7f-409e-496d-8433-a98f63f91f81+21:18816:x1875735392455808:12345-192.168.204.7@tcp:101:lfs.0 Request processed in 3034us (4184us total) trans 12884901900 rc 0/0 00000100:00100000:1.0:1788841375.209140:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 40 00000100:00100000:3.0:1788841375.214719:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:2.0:1788841375.215208:0:25016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392455936 00000100:00100000:2.0:1788841375.215222:0:25016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392455936 00000100:00100000:2.0:1788841375.215307:0:25016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 41 00000100:00100000:2.0:1788841375.215320:0:25016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b41324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fbb75a7f-409e-496d-8433-a98f63f91f81+21:18816:x1875735392455936:12345-192.168.204.7@tcp:54:lfs.0 00010000:00010000:2.0:1788841375.215433:0:25016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3c00/0x5757cd208ac387b3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841375.215460:0:25016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3c00/0x5757cd208ac387b3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841375.215568:0:25016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3c00/0x5757cd208ac387b3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841375.215617:0:25016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3c00/0x5757cd208ac387b3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841375.215626:0:25016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3c00/0x5757cd208ac387b3 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841375.215635:0:25016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3c00/0x5757cd208ac387b3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841375.215642:0:25016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b67bb3c00 already unused, calling callback (ffffffffc17b44f0) 00010000:00010000:2.0:1788841375.215648:0:25016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3c00/0x5757cd208ac387b3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841375.215657:0:25016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3c00/0x5757cd208ac387b3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841375.215672:0:25016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa04a46a6ca00) 00010000:00010000:2.0:1788841375.215675:0:25016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788841375.215680:0:25016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3c00/0x5757cd208ac387b3 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841375.215687:0:25016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3c00/0x5757cd208ac387b3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841375.215792:0:25016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b41324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fbb75a7f-409e-496d-8433-a98f63f91f81+21:18816:x1875735392455936:12345-192.168.204.7@tcp:54:lfs.0 Request processed in 474us (1088us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841375.215800:0:25016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 41 00000100:00100000:0.0:1788841375.223342:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:0.0:1788841375.223405:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:1.0:1788841375.223487:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392456320 00000100:00100000:1.0:1788841375.223506:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392456320 00000100:00100000:1.0:1788841375.223610:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 0 00000100:00100000:1.0:1788841375.223621:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6d9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fbb75a7f-409e-496d-8433-a98f63f91f81+21:2400:x1875735392456320:12345-192.168.204.7@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788841375.223638:0:22757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788841375.223669:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc7c00/0x5757cd208ac387a5 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b70 expref: 21 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841375.223691:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392456192 00010000:00010000:1.0:1788841375.223694:0:22757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa04a46a6ca00) 00000100:00100000:3.0:1788841375.223706:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392456192 00010000:00010000:1.0:1788841375.223707:0:22757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788841375.223816:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6d9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fbb75a7f-409e-496d-8433-a98f63f91f81+21:2400:x1875735392456320:12345-192.168.204.7@tcp:103:ldlm_bl.0 Request processed in 196us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841375.223825:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 0 00000100:00100000:3.0:1788841375.226073:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 7 00000100:00100000:3.0:1788841375.226118:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6d9f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fbb75a7f-409e-496d-8433-a98f63f91f81+20:18816:x1875735392456192:12345-192.168.204.7@tcp:35:lfs.0 00000100:00100000:3.0:1788841375.226549:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6d9f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fbb75a7f-409e-496d-8433-a98f63f91f81+21:18816:x1875735392456192:12345-192.168.204.7@tcp:35:lfs.0 Request processed in 459us (3224us total) trans 12884901901 rc 0/0 00000100:00100000:3.0:1788841375.226559:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 7 00000040:00080000:0.0:1788841375.374242:0:22808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788841375.558049:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:2.0:1788841375.558176:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392456576 00000100:00100000:2.0:1788841375.558190:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392456576 00000100:00100000:2.0:1788841375.558279:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 42 00000100:00100000:2.0:1788841375.558292:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6d9f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fbb75a7f-409e-496d-8433-a98f63f91f81+21:18847:x1875735392456576:12345-192.168.204.7@tcp:101:cat.0 00010000:00010000:2.0:1788841375.558329:0:22772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841375.558370:0:22772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3c00/0x5757cd208ac387ba lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x56167be89bd53b77 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841375.558540:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac387c1 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841375.558559:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac387c1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841375.558690:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac387c1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788841375.558708:0:22772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788841375.559051:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3c00/0x5757cd208ac387ba lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b77 expref: 24 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841375.559075:0:22772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac387c1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b77 expref: 23 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841375.559085:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa04a46a6ca00) 00010000:00010000:2.0:1788841375.559089:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788841375.559094:0:22772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04b67bb2600, rc 0) 00000100:00100000:2.0:1788841375.559182:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6d9f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fbb75a7f-409e-496d-8433-a98f63f91f81+23:18847:x1875735392456576:12345-192.168.204.7@tcp:101:cat.0 Request processed in 892us (1151us total) trans 12884901902 rc 0/0 00000100:00100000:2.0:1788841375.559212:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 42 00000100:00100000:3.0:1788841375.569817:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:3.0:1788841375.569889:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:2.0:1788841375.570776:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392456832 00000100:00100000:2.0:1788841375.570792:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392456832 00000100:00100000:2.0:1788841375.570887:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 8 00000100:00100000:2.0:1788841375.570900:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b41325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fbb75a7f-409e-496d-8433-a98f63f91f81+23:18847:x1875735392456832:12345-192.168.204.7@tcp:35:cat.0 00000100:00100000:2.0:1788841375.571293:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b41325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fbb75a7f-409e-496d-8433-a98f63f91f81+24:18847:x1875735392456832:12345-192.168.204.7@tcp:35:cat.0 Request processed in 394us (1490us total) trans 12884901903 rc 0/0 00000100:00100000:2.0:1788841375.571302:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 8 00000100:00100000:1.0:1788841375.571385:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392456960 00000100:00100000:1.0:1788841375.571391:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392456960 00000100:00100000:1.0:1788841375.571443:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 1 00000100:00100000:1.0:1788841375.571451:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7cb84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fbb75a7f-409e-496d-8433-a98f63f91f81+24:2401:x1875735392456960:12345-192.168.204.7@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788841375.571464:0:22758:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788841375.571495:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac387c1 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b77 expref: 24 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841375.571516:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa04a46a6ca00) 00010000:00010000:1.0:1788841375.571523:0:22758:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788841375.571558:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7cb84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fbb75a7f-409e-496d-8433-a98f63f91f81+23:2401:x1875735392456960:12345-192.168.204.7@tcp:103:ldlm_bl.0 Request processed in 110us (1670us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841375.571566:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 1 00000100:00100000:1.0:1788841375.660409:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:2.0:1788841375.660723:0:25016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392457216 00000100:00100000:2.0:1788841375.660738:0:25016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392457216 00000100:00100000:2.0:1788841375.660879:0:25016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 43 00000100:00100000:2.0:1788841375.660893:0:25016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7fb85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fbb75a7f-409e-496d-8433-a98f63f91f81+23:18853:x1875735392457216:12345-192.168.204.7@tcp:101:dd.0 00010000:00010000:2.0:1788841375.660934:0:25016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841375.660968:0:25016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3c00/0x5757cd208ac387cf lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x56167be89bd53b7e expref: -99 pid: 25016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841375.661131:0:25016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac387d6 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841375.661149:0:25016:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750b800/0x5757cd208ac38774 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b5b expref: 24 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841375.661158:0:25016:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4600/0x5757cd208ac38789 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b62 expref: 24 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841375.661168:0:25016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac387d6 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841375.661233:0:25016:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4600/0x5757cd208ac38789 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b62 expref: 24 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841375.661249:0:25016:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4600/0x5757cd208ac38789 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b62 expref: 24 pid: 22773 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841375.661264:0:25016:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6e05ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25016:1875735413545856:192.168.204.7@tcp:104: 00010000:00010000:2.0:1788841375.661668:0:25016:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750b800/0x5757cd208ac38774 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b5b expref: 24 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841375.661679:0:25016:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750b800/0x5757cd208ac38774 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b5b expref: 24 pid: 22774 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841375.661689:0:25016:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b491d2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25016:1875735413545984:192.168.204.7@tcp:104: 00000100:00100000:2.0:1788841375.661718:0:25016:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b6e1daf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788841375.673806:0:25016:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6e05ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25016:1875735413545856:192.168.204.7@tcp:104: 00000100:00100000:2.0:1788841375.673875:0:25016:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b491d2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25016:1875735413545984:192.168.204.7@tcp:104: 00010000:00010000:2.0:1788841375.673918:0:25016:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac387d6 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841375.674444:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:1.0:1788841375.674505:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:2.0:1788841375.674877:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392457344 00000100:00100000:2.0:1788841375.674887:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392457344 00010000:00010000:2.0:1788841375.674936:0:22758:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4600/0x5757cd208ac38789 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b62 expref: 25 pid: 22773 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841375.674976:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392457472 00000100:00100000:2.0:1788841375.674991:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392457472 00010000:00010000:2.0:1788841375.675008:0:22758:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750b800/0x5757cd208ac38774 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b5b expref: 26 pid: 22774 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841375.675027:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 17 00000100:00100000:2.0:1788841375.675038:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7fb85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fbb75a7f-409e-496d-8433-a98f63f91f81+26:2400:x1875735392457344:12345-192.168.204.7@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788841375.675060:0:22758:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788841375.675069:0:22758:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4600/0x5757cd208ac38789 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b62 expref: 26 pid: 22773 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841375.675085:0:22758:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4600/0x5757cd208ac38789 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b62 expref: 26 pid: 22773 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841375.675115:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4600/0x5757cd208ac38789 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b62 expref: 26 pid: 22773 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841375.675136:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa04a46a6ca00) 00010000:00010000:2.0:1788841375.675142:0:22758:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac387d6 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841375.675153:0:22758:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac387d6 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841375.675161:0:22758:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788841375.675237:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7fb85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fbb75a7f-409e-496d-8433-a98f63f91f81+25:2400:x1875735392457344:12345-192.168.204.7@tcp:103:ldlm_bl.0 Request processed in 200us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841375.675245:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 17 00000100:00100000:2.0:1788841375.675265:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 18 00000100:00100000:2.0:1788841375.675272:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7cb41050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fbb75a7f-409e-496d-8433-a98f63f91f81+24:2400:x1875735392457472:12345-192.168.204.7@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788841375.675287:0:22758:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788841375.675293:0:22758:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750b800/0x5757cd208ac38774 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b5b expref: 24 pid: 22774 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841375.675305:0:22758:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750b800/0x5757cd208ac38774 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b5b expref: 24 pid: 22774 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841375.675318:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750b800/0x5757cd208ac38774 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b5b expref: 24 pid: 22774 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841375.675329:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa04a46a6ca00) 00010000:00010000:2.0:1788841375.675333:0:22758:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac387d6 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841375.675343:0:22758:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac387d6 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841375.675362:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac387d6 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841375.676107:0:22758:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788841375.676158:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7cb41050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fbb75a7f-409e-496d-8433-a98f63f91f81+23:2400:x1875735392457472:12345-192.168.204.7@tcp:103:ldlm_bl.0 Request processed in 882us (1648us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841375.676168:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 18 00010000:00010000:2.0:1788841375.676239:0:25016:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac387d6 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841375.676248:0:25016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac387d6 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788841375.676289:0:25016:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788841375.676766:0:25016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3c00/0x5757cd208ac387cf lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b7e expref: 24 pid: 25016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841375.676788:0:25016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2600/0x5757cd208ac387d6 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b7e expref: 23 pid: 25016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841375.676797:0:25016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa04a46a6ca00) 00010000:00010000:2.0:1788841375.676800:0:25016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788841375.676803:0:25016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04b67bb2600, rc 0) 00000100:00100000:2.0:1788841375.676862:0:25016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7fb85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fbb75a7f-409e-496d-8433-a98f63f91f81+23:18853:x1875735392457216:12345-192.168.204.7@tcp:101:dd.0 Request processed in 15973us (16481us total) trans 12884901904 rc 0/0 00000100:00100000:2.0:1788841375.676875:0:25016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 43 00000100:00100000:1.0:1788841375.680208:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:2.0:1788841375.680320:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392457600 00000100:00100000:2.0:1788841375.680332:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392457600 00000100:00100000:2.0:1788841375.680492:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 44 00000100:00100000:2.0:1788841375.680506:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7fb87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fbb75a7f-409e-496d-8433-a98f63f91f81+23:18853:x1875735392457600:12345-192.168.204.7@tcp:101:dd.0 00010000:00010000:2.0:1788841375.680539:0:22772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841375.680569:0:22772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3600/0x5757cd208ac387e4 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x56167be89bd53b85 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841375.680613:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2400/0x5757cd208ac387eb lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841375.680632:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2400/0x5757cd208ac387eb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841375.680675:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2400/0x5757cd208ac387eb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841375.680826:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3600/0x5757cd208ac387e4 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b85 expref: 25 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841375.680887:0:22772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2400/0x5757cd208ac387eb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b85 expref: 24 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841375.680897:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa04a46a6ca00) 00010000:00010000:2.0:1788841375.680901:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788841375.680906:0:22772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04b67bb2400, rc 0) 00000100:00100000:2.0:1788841375.681031:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7fb87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fbb75a7f-409e-496d-8433-a98f63f91f81+24:18853:x1875735392457600:12345-192.168.204.7@tcp:101:dd.0 Request processed in 527us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841375.681039:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 44 00000100:00100000:0.0:1788841375.685213:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:3.0:1788841375.686316:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392457856 00000100:00100000:3.0:1788841375.686338:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392457856 00000100:00100000:3.0:1788841375.686513:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 45 00000100:00100000:3.0:1788841375.686527:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6d9f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fbb75a7f-409e-496d-8433-a98f63f91f81+24:18853:x1875735392457856:12345-192.168.204.7@tcp:36:dd.0 00010000:00010000:3.0:1788841375.687169:0:22774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4400/0x5757cd208ac387f2 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841375.687200:0:22774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4400/0x5757cd208ac387f2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841375.687217:0:22774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4400/0x5757cd208ac387f2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788841375.687278:0:22774:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:3.0:1788841375.687330:0:22774:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dffb3b4c reply state 000000005bae4cd6 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4400/0x5757cd208ac387f2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841375.687358:0:22774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4400/0x5757cd208ac387f2 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841375.687368:0:22774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa04a46a6ca00) 00010000:00010000:3.0:1788841375.687371:0:22774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788841375.687375:0:22774:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788841375.687652:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6d9f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fbb75a7f-409e-496d-8433-a98f63f91f81+27:18853:x1875735392457856:12345-192.168.204.7@tcp:36:dd.0 Request processed in 1124us (2452us total) trans 12884901906 rc 0/0 00000100:00100000:3.0:1788841375.687662:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 45 00000020:00080000:3.0:1788841375.687671:0:22774:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788841375.689766:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:1.0:1788841375.689924:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392457984 00000100:00100000:1.0:1788841375.689937:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392457984 00000100:00100000:1.0:1788841375.690057:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 46 00000100:00100000:1.0:1788841375.690071:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7cb85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fbb75a7f-409e-496d-8433-a98f63f91f81+27:18853:x1875735392457984:12345-192.168.204.7@tcp:101:dd.0 00010000:00010000:1.0:1788841375.690103:0:22773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788841375.690131:0:22773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6400/0x5757cd208ac387f9 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x56167be89bd53b8c expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841375.690210:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6400/0x5757cd208ac387f9 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b8c expref: 28 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841375.690227:0:22773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6400/0x5757cd208ac387f9 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b8c expref: 28 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841375.690250:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa04a46a6ca00) 00010000:00010000:1.0:1788841375.690254:0:22773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788841375.690259:0:22773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04b48dc6400, rc 0) 00000100:00100000:1.0:1788841375.690338:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7cb85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fbb75a7f-409e-496d-8433-a98f63f91f81+28:18853:x1875735392457984:12345-192.168.204.7@tcp:101:dd.0 Request processed in 268us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841375.690357:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 46 00000100:00100000:1.0:1788841375.721758:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:2.0:1788841375.722030:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392458240 00000100:00100000:2.0:1788841375.722045:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392458240 00000100:00100000:2.0:1788841375.722144:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 2 00000100:00100000:2.0:1788841375.722157:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7fb85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fbb75a7f-409e-496d-8433-a98f63f91f81+28:18853:x1875735392458240:12345-192.168.204.7@tcp:103:dd.0 00010000:00010000:2.0:1788841375.722182:0:22758:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788841375.722218:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6400/0x5757cd208ac387f9 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b8c expref: 28 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841375.722242:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa04a46a6ca00) 00010000:00010000:2.0:1788841375.722257:0:22758:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788841375.722332:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7fb85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fbb75a7f-409e-496d-8433-a98f63f91f81+27:18853:x1875735392458240:12345-192.168.204.7@tcp:103:dd.0 Request processed in 177us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841375.722358:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 2 00000100:00100000:0.0:1788841375.726302:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:2.0:1788841375.726417:0:25016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392458368 00000100:00100000:2.0:1788841375.726431:0:25016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392458368 00000100:00100000:2.0:1788841375.726529:0:25016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 47 00000100:00100000:2.0:1788841375.726542:0:25016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6d9f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fbb75a7f-409e-496d-8433-a98f63f91f81+27:18853:x1875735392458368:12345-192.168.204.7@tcp:58:dd.0 00010000:00010000:2.0:1788841375.726700:0:25016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3600/0x5757cd208ac38800 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841375.726729:0:25016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3600/0x5757cd208ac38800 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841375.726743:0:25016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3600/0x5757cd208ac38800 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788841375.730279:0:25016:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788841375.730334:0:25016:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:2.0:1788841375.733192:0:25016:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:2.0:1788841375.733404:0:25016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6d9f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fbb75a7f-409e-496d-8433-a98f63f91f81+27:18853:x1875735392458368:12345-192.168.204.7@tcp:58:dd.0 Request processed in 6854us (7107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841375.733427:0:25016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 47 00000100:00100000:1.0:1788841375.741266:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:2.0:1788841375.741742:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392458496 00000100:00100000:2.0:1788841375.741757:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392458496 00000100:00100000:2.0:1788841375.742219:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 48 00000100:00100000:2.0:1788841375.742234:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b81b22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fbb75a7f-409e-496d-8433-a98f63f91f81+27:18853:x1875735392458496:12345-192.168.204.7@tcp:101:dd.0 00010000:00010000:2.0:1788841375.742272:0:22772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841375.742301:0:22772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3c00/0x5757cd208ac38807 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x56167be89bd53b93 expref: -99 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841375.742420:0:22772:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3600/0x5757cd208ac38800 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841375.742432:0:22772:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3c00/0x5757cd208ac38807 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b93 expref: 28 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841375.742461:0:22772:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3600/0x5757cd208ac38800 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841375.742484:0:22772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3c00/0x5757cd208ac38807 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b93 expref: 28 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841375.742502:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa04a46a6ca00) 00010000:00010000:2.0:1788841375.742506:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788841375.742510:0:22772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3c00/0x5757cd208ac38807 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b93 expref: 28 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841375.742518:0:22772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04b67bb3c00, rc 0) 00000100:00100000:2.0:1788841375.742601:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b81b22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fbb75a7f-409e-496d-8433-a98f63f91f81+28:18853:x1875735392458496:12345-192.168.204.7@tcp:101:dd.0 Request processed in 371us (1365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841375.742609:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 48 00010000:00010000:2.0:1788841376.077098:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788841376.148179:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:1.0:1788841376.148238:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:1.0:1788841376.148293:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:1.0:1788841376.148330:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:1.0:1788841376.148371:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:1.0:1788841376.148415:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:2.0:1788841376.148433:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392459008 00000100:00100000:1.0:1788841376.148440:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:2.0:1788841376.148448:0:24278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392459008 00000100:00100000:2.0:1788841376.148533:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392458880 00000100:00100000:2.0:1788841376.148537:0:24278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392458880 00000100:00100000:2.0:1788841376.148556:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392459520 00000100:00100000:2.0:1788841376.148559:0:24278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392459520 00000100:00100000:2.0:1788841376.148606:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 21 00000100:00100000:2.0:1788841376.148618:0:24278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b581a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fbb75a7f-409e-496d-8433-a98f63f91f81+5:2402:x1875735392459008:12345-192.168.204.7@tcp:400:kworker.0 00000100:00100000:1.0:1788841376.148676:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:2.0:1788841376.148720:0:24278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b581a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fbb75a7f-409e-496d-8433-a98f63f91f81+5:2402:x1875735392459008:12345-192.168.204.7@tcp:400:kworker.0 Request processed in 103us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841376.148729:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 21 00000100:00100000:2.0:1788841376.148747:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392459392 00000100:00100000:2.0:1788841376.148750:0:24278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392459392 00000100:00100000:2.0:1788841376.148767:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 22 00000100:00100000:2.0:1788841376.148774:0:24278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b581a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fbb75a7f-409e-496d-8433-a98f63f91f81+5:2403:x1875735392458880:12345-192.168.204.7@tcp:400:kworker.0 00000100:00100000:3.0:1788841376.148888:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392458752 00000100:00100000:3.0:1788841376.148894:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392458752 00000100:00100000:3.0:1788841376.148930:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392459264 00000100:00100000:3.0:1788841376.148934:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392459264 00000100:00100000:3.0:1788841376.148946:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392459136 00000100:00100000:3.0:1788841376.148947:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392459136 00000100:00100000:3.0:1788841376.148962:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 65 00000100:00100000:3.0:1788841376.148969:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b81b21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fbb75a7f-409e-496d-8433-a98f63f91f81+5:2402:x1875735392458752:12345-192.168.204.7@tcp:400:kworker.0 00000100:00100000:0.0:1788841376.149113:0:24279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 23 00000100:00100000:0.0:1788841376.149125:0:24279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b581a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+5:2402:x1875735392459520:12345-192.168.204.7@tcp:400:kworker.0 00000100:00100000:1.0:1788841376.154290:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 66 00000100:00100000:1.0:1788841376.154319:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b581a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+5:2402:x1875735392459264:12345-192.168.204.7@tcp:400:kworker.0 00000100:00100000:2.0:1788841376.154657:0:24278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b581a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fbb75a7f-409e-496d-8433-a98f63f91f81+5:2403:x1875735392458880:12345-192.168.204.7@tcp:400:kworker.0 Request processed in 5879us (6282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841376.154671:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 22 00000100:00100000:2.0:1788841376.154706:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 24 00000100:00100000:2.0:1788841376.154718:0:24278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6d9e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+5:2403:x1875735392459392:12345-192.168.204.7@tcp:400:kworker.0 00000100:00100000:0.0:1788841376.155014:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392458624 00000100:00100000:0.0:1788841376.155027:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392458624 00000100:00100000:0.0:1788841376.155087:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 167 00000100:00100000:0.0:1788841376.155096:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7060e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25ddc60b-4cfa-4441-9231-3253d5543004+13:2403:x1875735392458624:12345-192.168.204.7@tcp:400:kworker.0 00000100:00100000:1.0:1788841376.159970:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b581a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+5:2402:x1875735392459264:12345-192.168.204.7@tcp:400:kworker.0 Request processed in 5643us (11617us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841376.159992:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 66 00000100:00100000:1.0:1788841376.160078:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 67 00000100:00100000:1.0:1788841376.160106:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6d9e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+12:2403:x1875735392459136:12345-192.168.204.7@tcp:400:kworker.0 00000100:00100000:1.0:1788841376.160239:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6d9e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+12:2403:x1875735392459136:12345-192.168.204.7@tcp:400:kworker.0 Request processed in 151us (11797us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841376.160246:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 67 00000100:00100000:1.0:1788841376.161065:0:24279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b581a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+5:2402:x1875735392459520:12345-192.168.204.7@tcp:400:kworker.0 Request processed in 11936us (12641us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841376.161079:0:24279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 23 00000100:00080000:1.0:1788841376.161185:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788841376.161193:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788841376.161198:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788841376.161201:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788841376.162137:0:24278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6d9e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0d1154f-b1a6-4aec-8748-5f2bf9a8bae0+5:2403:x1875735392459392:12345-192.168.204.7@tcp:400:kworker.0 Request processed in 7411us (13448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841376.162153:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 24 00000100:00100000:3.0:1788841376.164198:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b81b21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fbb75a7f-409e-496d-8433-a98f63f91f81+5:2402:x1875735392458752:12345-192.168.204.7@tcp:400:kworker.0 Request processed in 15207us (16015us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841376.164219:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 65 00000100:00100000:0.0:1788841376.166388:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7060e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25ddc60b-4cfa-4441-9231-3253d5543004+13:2403:x1875735392458624:12345-192.168.204.7@tcp:400:kworker.0 Request processed in 11268us (18069us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841376.166731:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 167 00000040:00080000:0.0:1788841376.397231:0:22808:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788841376.397255:0:22808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788841376.397295:0:22808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1788841376.397306:0:22808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788841376.398826:0:22808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6d9f0a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22808:1875735413546112:192.168.204.7@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788841376.398985:0:22808:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b6e077c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788841376.413013:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:2.0:1788841376.413167:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392459648 00000100:00100000:2.0:1788841376.413180:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392459648 00000100:00100000:2.0:1788841376.413289:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 49 00000100:00100000:2.0:1788841376.413302:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7d5b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fbb75a7f-409e-496d-8433-a98f63f91f81+29:18854:x1875735392459648:12345-192.168.204.7@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788841376.413357:0:22773:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788841376.413537:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7d5b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fbb75a7f-409e-496d-8433-a98f63f91f81+29:18854:x1875735392459648:12345-192.168.204.7@tcp:53:lhsmtool_posix.0 Request processed in 238us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841376.413545:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 49 00000100:00100000:0.0:1788841376.414254:0:22808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6d9f0a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22808:1875735413546112:192.168.204.7@tcp:107:hsm_cdtr.0 00000100:00080000:1.0:1788841376.415115:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788841376.418760:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:3.0:1788841376.418886:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392459776 00000100:00100000:3.0:1788841376.418901:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392459776 00000100:00100000:3.0:1788841376.418976:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 50 00000100:00100000:3.0:1788841376.418988:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7d5b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fbb75a7f-409e-496d-8433-a98f63f91f81+28:18854:x1875735392459776:12345-192.168.204.7@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788841376.419123:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4200/0x5757cd208ac3880e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841376.419146:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4200/0x5757cd208ac3880e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841376.419161:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4200/0x5757cd208ac3880e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841376.419322:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4e00/0x5757cd208ac38815 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841376.419363:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4e00/0x5757cd208ac38815 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841376.419377:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4e00/0x5757cd208ac38815 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841376.419416:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4c00/0x5757cd208ac3881c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841376.419425:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4c00/0x5757cd208ac3881c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841376.419431:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4c00/0x5757cd208ac3881c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788841376.419485:0:22772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788841376.419490:0:22772:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788841376.419510:0:22772:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4c00/0x5757cd208ac3881c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841376.419521:0:22772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4200/0x5757cd208ac3880e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841376.419541:0:22772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4200/0x5757cd208ac3880e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841376.419548:0:22772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4200/0x5757cd208ac3880e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841376.419554:0:22772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b7f8c4200 already unused, calling callback (ffffffffc17b44f0) 00010000:00010000:3.0:1788841376.419559:0:22772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4200/0x5757cd208ac3880e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841376.419568:0:22772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4200/0x5757cd208ac3880e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841376.419581:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa04a47b30000) 00010000:00010000:3.0:1788841376.419585:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788841376.419590:0:22772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4200/0x5757cd208ac3880e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841376.419596:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4200/0x5757cd208ac3880e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841376.419613:0:22772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4e00/0x5757cd208ac38815 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841376.419618:0:22772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4e00/0x5757cd208ac38815 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841376.419624:0:22772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4e00/0x5757cd208ac38815 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841376.419629:0:22772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b7f8c4e00 already unused, calling callback (ffffffffc17b44f0) 00010000:00010000:3.0:1788841376.419637:0:22772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4e00/0x5757cd208ac38815 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841376.419644:0:22772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4e00/0x5757cd208ac38815 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841376.419652:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffffa04b558f7300) 00010000:00010000:3.0:1788841376.419654:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788841376.419657:0:22772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4e00/0x5757cd208ac38815 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841376.419663:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4e00/0x5757cd208ac38815 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841376.419677:0:22772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4c00/0x5757cd208ac3881c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841376.419683:0:22772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4c00/0x5757cd208ac3881c lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841376.419689:0:22772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4c00/0x5757cd208ac3881c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841376.419694:0:22772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b7f8c4c00 already unused, calling callback (ffffffffc17b44f0) 00010000:00010000:3.0:1788841376.419697:0:22772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4c00/0x5757cd208ac3881c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841376.419703:0:22772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4c00/0x5757cd208ac3881c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841376.419709:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa04a46a6ca00) 00010000:00010000:3.0:1788841376.419711:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788841376.419720:0:22772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4c00/0x5757cd208ac3881c lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841376.419726:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4c00/0x5757cd208ac3881c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841376.423158:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7d5b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fbb75a7f-409e-496d-8433-a98f63f91f81+28:18854:x1875735392459776:12345-192.168.204.7@tcp:34:lhsmtool_posix.0 Request processed in 841us (1081us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841376.423177:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 50 00000100:00100000:1.0:1788841376.423801:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:2.0:1788841376.424008:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392460032 00000100:00100000:2.0:1788841376.424017:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392460032 00000100:00100000:2.0:1788841376.424083:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 51 00000100:00100000:2.0:1788841376.424094:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7d5b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fbb75a7f-409e-496d-8433-a98f63f91f81+28:18854:x1875735392460032:12345-192.168.204.7@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788841376.424118:0:22773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841376.424141:0:22773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3a00/0x5757cd208ac38823 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x56167be89bd53b9a expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841376.424270:0:22773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2c00/0x5757cd208ac3882a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841376.424287:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2c00/0x5757cd208ac3882a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841376.424298:0:22773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2c00/0x5757cd208ac3882a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788841376.424310:0:22773:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788841376.425101:0:22773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2c00/0x5757cd208ac3882a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841376.425113:0:22773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2c00/0x5757cd208ac3882a lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841376.425120:0:22773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2c00/0x5757cd208ac3882a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841376.425126:0:22773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b67bb2c00 already unused, calling callback (ffffffffc17b44f0) 00010000:00010000:2.0:1788841376.425130:0:22773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2c00/0x5757cd208ac3882a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841376.425138:0:22773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2c00/0x5757cd208ac3882a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841376.425172:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa04a46a6ca00) 00010000:00010000:2.0:1788841376.425176:0:22773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788841376.425181:0:22773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2c00/0x5757cd208ac3882a lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841376.425187:0:22773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2c00/0x5757cd208ac3882a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841376.425243:0:22773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3a00/0x5757cd208ac38823 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b9a expref: 30 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841376.425254:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa04a47b30000) 00010000:00010000:2.0:1788841376.425256:0:22773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788841376.425260:0:22773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3a00/0x5757cd208ac38823 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b9a expref: 30 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841376.425270:0:22773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04b67bb3a00, rc 0) 00000100:00100000:2.0:1788841376.428081:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7d5b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fbb75a7f-409e-496d-8433-a98f63f91f81+29:18854:x1875735392460032:12345-192.168.204.7@tcp:101:lhsmtool_posix.0 Request processed in 3975us (4269us total) trans 12884901907 rc 301/301 00000100:00100000:2.0:1788841376.428095:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 51 00000100:00100000:1.0:1788841376.446036:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:0.0:1788841376.446188:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392460160 00000100:00100000:0.0:1788841376.446201:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392460160 00000100:00100000:0.0:1788841376.446268:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 52 00000100:00100000:0.0:1788841376.446281:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7d5b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fbb75a7f-409e-496d-8433-a98f63f91f81+29:18854:x1875735392460160:12345-192.168.204.7@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788841376.446328:0:22774:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788841376.446491:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7d5b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fbb75a7f-409e-496d-8433-a98f63f91f81+29:18854:x1875735392460160:12345-192.168.204.7@tcp:53:lhsmtool_posix.0 Request processed in 213us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841376.446500:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 52 00000100:00100000:1.0:1788841376.450276:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:3.0:1788841376.453529:0:25016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392460416 00000100:00100000:3.0:1788841376.453546:0:25016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392460416 00000100:00100000:3.0:1788841376.453629:0:25016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 53 00000100:00100000:3.0:1788841376.453641:0:25016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7d5b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fbb75a7f-409e-496d-8433-a98f63f91f81+29:18854:x1875735392460416:12345-192.168.204.7@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788841376.453666:0:25016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788841376.453689:0:25016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4c00/0x5757cd208ac38838 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x56167be89bd53ba1 expref: -99 pid: 25016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788841376.454221:0:25016:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x7:0x0], count =59 00000004:00080000:3.0:1788841376.454228:0:25016:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x7:0x0]+59 in llog 00000004:00080000:3.0:1788841376.454245:0:25016:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:3.0:1788841376.454402:0:25016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4e00/0x5757cd208ac3883f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841376.454419:0:25016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4e00/0x5757cd208ac3883f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841376.454430:0:25016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4e00/0x5757cd208ac3883f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841376.454490:0:25016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4c00/0x5757cd208ac38838 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53ba1 expref: 32 pid: 25016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841376.454517:0:25016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4e00/0x5757cd208ac3883f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53ba1 expref: 31 pid: 25016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841376.454525:0:25016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffffa04b558f7300) 00010000:00010000:3.0:1788841376.454528:0:25016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788841376.454531:0:25016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04b7f8c4e00, rc 0) 00000100:00100000:3.0:1788841376.454626:0:25016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7d5b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fbb75a7f-409e-496d-8433-a98f63f91f81+31:18854:x1875735392460416:12345-192.168.204.7@tcp:101:lhsmtool_posix.0 Request processed in 986us (4358us total) trans 12884901908 rc 0/0 00000100:00100000:3.0:1788841376.454633:0:25016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 53 00000100:00100000:2.0:1788841376.464703:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:0.0:1788841376.464889:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392460672 00000100:00100000:0.0:1788841376.464905:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392460672 00000100:00100000:0.0:1788841376.464981:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 54 00000100:00100000:0.0:1788841376.464993:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b491d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fbb75a7f-409e-496d-8433-a98f63f91f81+31:18854:x1875735392460672:12345-192.168.204.7@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788841376.465056:0:22774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788841376.465086:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4e00/0x5757cd208ac3883f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53ba1 expref: 31 pid: 25016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841376.465107:0:22774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffffa04b558f7300) 00010000:00010000:0.0:1788841376.465119:0:22774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788841376.465146:0:22774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750a400/0x5757cd208ac3884d lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841376.465430:0:22774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750a400/0x5757cd208ac3884d lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841376.465445:0:22774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750a400/0x5757cd208ac3884d lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841376.465462:0:22774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750aa00/0x5757cd208ac38854 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x4cb091ba bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841376.465485:0:22774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750aa00/0x5757cd208ac38854 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x4cb091ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841376.465493:0:22774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750aa00/0x5757cd208ac38854 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x4cb091ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841376.465546:0:22774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750a400/0x5757cd208ac3884d lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841376.465554:0:22774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750a400/0x5757cd208ac3884d lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841376.465560:0:22774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750a400/0x5757cd208ac3884d lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841376.465567:0:22774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a4750a400 already unused, calling callback (ffffffffc17b44f0) 00010000:00010000:0.0:1788841376.465571:0:22774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750a400/0x5757cd208ac3884d lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841376.465579:0:22774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750a400/0x5757cd208ac3884d lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841376.465588:0:22774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa04b558f7000) 00010000:00010000:0.0:1788841376.465591:0:22774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788841376.465595:0:22774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750a400/0x5757cd208ac3884d lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841376.465601:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750a400/0x5757cd208ac3884d lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841376.465610:0:22774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750aa00/0x5757cd208ac38854 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x4cb091ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841376.465622:0:22774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750aa00/0x5757cd208ac38854 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x4cb091ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841376.465628:0:22774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750aa00/0x5757cd208ac38854 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x4cb091ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841376.465633:0:22774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a4750aa00 already unused, calling callback (ffffffffc17b44f0) 00010000:00010000:0.0:1788841376.465637:0:22774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750aa00/0x5757cd208ac38854 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x4cb091ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841376.465644:0:22774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750aa00/0x5757cd208ac38854 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x4cb091ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841376.465651:0:22774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x4cb091ba (ffffa04a46a6c100) 00010000:00010000:0.0:1788841376.465654:0:22774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788841376.465657:0:22774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750aa00/0x5757cd208ac38854 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x4cb091ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841376.465663:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750aa00/0x5757cd208ac38854 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x4cb091ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841376.465800:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b491d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fbb75a7f-409e-496d-8433-a98f63f91f81+30:18854:x1875735392460672:12345-192.168.204.7@tcp:36:lhsmtool_posix.0 Request processed in 809us (1108us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788841376.465808:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 54 00000100:00100000:1.0:1788841376.479391:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:3.0:1788841376.481325:0:25016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392460800 00000100:00100000:3.0:1788841376.481354:0:25016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392460800 00000100:00100000:3.0:1788841376.481440:0:25016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 55 00000100:00100000:3.0:1788841376.481452:0:25016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7d5b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fbb75a7f-409e-496d-8433-a98f63f91f81+30:18854:x1875735392460800:12345-192.168.204.7@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788841376.481476:0:25016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788841376.481501:0:25016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4c00/0x5757cd208ac3885b lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x56167be89bd53ba8 expref: -99 pid: 25016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841376.481539:0:25016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4200/0x5757cd208ac38862 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841376.481552:0:25016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4200/0x5757cd208ac38862 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841376.481563:0:25016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4200/0x5757cd208ac38862 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841376.481686:0:25016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4c00/0x5757cd208ac3885b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53ba8 expref: 32 pid: 25016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841376.481716:0:25016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4200/0x5757cd208ac38862 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53ba8 expref: 31 pid: 25016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841376.481726:0:25016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffffa04b558f7400) 00010000:00010000:3.0:1788841376.481729:0:25016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788841376.481732:0:25016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04b7f8c4200, rc 0) 00000100:00100000:3.0:1788841376.481814:0:25016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7d5b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fbb75a7f-409e-496d-8433-a98f63f91f81+31:18854:x1875735392460800:12345-192.168.204.7@tcp:101:lhsmtool_posix.0 Request processed in 364us (2436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841376.481821:0:25016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 55 00000100:00100000:2.0:1788841376.488207:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:1.0:1788841376.489509:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392461056 00000100:00100000:1.0:1788841376.489523:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392461056 00000100:00100000:1.0:1788841376.489606:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 56 00000100:00100000:1.0:1788841376.489618:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b491d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fbb75a7f-409e-496d-8433-a98f63f91f81+31:18854:x1875735392461056:12345-192.168.204.7@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788841376.489739:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6400/0x5757cd208ac38869 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.489763:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6400/0x5757cd208ac38869 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.489779:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6400/0x5757cd208ac38869 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788841376.491383:0:22772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:1.0:1788841376.491404:0:22772:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 810685569898ns, next at 811685566506ns, rc = 0 00000004:00010000:1.0:1788841376.491480:0:22772:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b060f350 reply state 00000000ca171457 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6400/0x5757cd208ac38869 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.491504:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6400/0x5757cd208ac38869 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.491514:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffffa04b558f7400) 00010000:00010000:1.0:1788841376.491517:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788841376.491538:0:22772:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788841376.491694:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b491d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fbb75a7f-409e-496d-8433-a98f63f91f81+33:18854:x1875735392461056:12345-192.168.204.7@tcp:36:lhsmtool_posix.0 Request processed in 2074us (3493us total) trans 12884901909 rc 0/0 00000100:00100000:1.0:1788841376.491704:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 56 00000100:00100000:1.0:1788841376.497104:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:2.0:1788841376.497256:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392461184 00000100:00100000:2.0:1788841376.497267:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392461184 00000100:00100000:2.0:1788841376.497351:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 57 00000100:00100000:2.0:1788841376.497367:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7d5b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fbb75a7f-409e-496d-8433-a98f63f91f81+33:18854:x1875735392461184:12345-192.168.204.7@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788841376.497405:0:22773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841376.497446:0:22773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67521400/0x5757cd208ac38870 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x56167be89bd53baf expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841376.497524:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67521400/0x5757cd208ac38870 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53baf expref: 34 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841376.497538:0:22773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67521400/0x5757cd208ac38870 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53baf expref: 34 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841376.497559:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffffa04b558f7400) 00010000:00010000:2.0:1788841376.497563:0:22773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788841376.497567:0:22773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04b67521400, rc 0) 00000100:00100000:2.0:1788841376.497637:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7d5b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fbb75a7f-409e-496d-8433-a98f63f91f81+34:18854:x1875735392461184:12345-192.168.204.7@tcp:101:lhsmtool_posix.0 Request processed in 277us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841376.497645:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 57 00000100:00100000:2.0:1788841376.508969:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:1.0:1788841376.509966:0:24279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392461312 00000100:00100000:1.0:1788841376.509985:0:24279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392461312 00000100:00100000:1.0:1788841376.510066:0:24279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 26 00000100:00100000:1.0:1788841376.510078:0:24279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b491d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fbb75a7f-409e-496d-8433-a98f63f91f81+5:2401:x1875735392461312:12345-192.168.204.7@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788841376.510391:0:24279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b491d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fbb75a7f-409e-496d-8433-a98f63f91f81+6:2401:x1875735392461312:12345-192.168.204.7@tcp:2:lhsmtool_posix.0 Request processed in 315us (1433us total) trans 12884901891 rc 0/0 00000100:00100000:1.0:1788841376.510399:0:24279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 26 00000100:00100000:0.0:1788841376.526131:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:2.0:1788841376.527289:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392461568 00000100:00100000:2.0:1788841376.527306:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392461568 00000100:00100000:2.0:1788841376.527406:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 9 00000100:00100000:2.0:1788841376.527420:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6d9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fbb75a7f-409e-496d-8433-a98f63f91f81+34:18854:x1875735392461568:12345-192.168.204.7@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788841376.527747:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6d9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fbb75a7f-409e-496d-8433-a98f63f91f81+35:18854:x1875735392461568:12345-192.168.204.7@tcp:35:lhsmtool_posix.0 Request processed in 329us (1627us total) trans 12884901910 rc 0/0 00000100:00100000:2.0:1788841376.527756:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 9 00000100:00100000:3.0:1788841376.531128:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:1.0:1788841376.533772:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392461824 00000100:00100000:1.0:1788841376.533789:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392461824 00000100:00100000:1.0:1788841376.533950:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 58 00000100:00100000:1.0:1788841376.533963:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7cb87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fbb75a7f-409e-496d-8433-a98f63f91f81+35:18854:x1875735392461824:12345-192.168.204.7@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788841376.534105:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7cb87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fbb75a7f-409e-496d-8433-a98f63f91f81+35:18854:x1875735392461824:12345-192.168.204.7@tcp:57:lhsmtool_posix.0 Request processed in 144us (2996us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841376.534112:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 58 00000100:00100000:1.0:1788841376.539361:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:2.0:1788841376.540324:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392461952 00000100:00100000:2.0:1788841376.540353:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392461952 00000100:00100000:2.0:1788841376.540801:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 59 00000100:00100000:2.0:1788841376.540814:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7d5b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fbb75a7f-409e-496d-8433-a98f63f91f81+35:18854:x1875735392461952:12345-192.168.204.7@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788841376.540895:0:22773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788841376.540925:0:22773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67521600/0x5757cd208ac38877 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x56167be89bd53bb6 expref: -99 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841376.541112:0:22773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67521800/0x5757cd208ac3887e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841376.541135:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67521800/0x5757cd208ac3887e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841376.541150:0:22773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67521800/0x5757cd208ac3887e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788841376.541220:0:22773:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788841376.541561:0:22773:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67521800/0x5757cd208ac3887e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841376.541600:0:22773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67521600/0x5757cd208ac38877 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53bb6 expref: 37 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841376.541624:0:22773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67521800/0x5757cd208ac3887e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53bb6 expref: 36 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841376.541636:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffffa04b558f7400) 00010000:00010000:2.0:1788841376.541639:0:22773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788841376.541643:0:22773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04b67521800, rc 0) 00000100:00100000:2.0:1788841376.541784:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7d5b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fbb75a7f-409e-496d-8433-a98f63f91f81+36:18854:x1875735392461952:12345-192.168.204.7@tcp:101:lhsmtool_posix.0 Request processed in 972us (2440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841376.541793:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 59 00000100:00100000:2.0:1788841376.566245:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:1.0:1788841376.568884:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392462080 00000100:00100000:1.0:1788841376.568911:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392462080 00000100:00100000:1.0:1788841376.569224:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 27 00000100:00100000:1.0:1788841376.569238:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b491d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fbb75a7f-409e-496d-8433-a98f63f91f81+6:2400:x1875735392462080:12345-192.168.204.7@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788841376.569262:0:24277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788841376.569292:0:24277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000005695be/0x5757cd208ac38885 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x56167be89bd53bbd expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788841376.569363:0:24277:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f8d9f, blocks: 0x0 00010000:00010000:1.0:1788841376.569402:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=810s v=(0 0) 00010000:00010000:1.0:1788841376.569408:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788841376.569423:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000005695be/0x5757cd208ac38885 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53bbd expref: 7 pid: 24277 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.569451:0:24277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000005695be/0x5757cd208ac38885 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53bbd expref: 7 pid: 24277 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.569471:0:24277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04b48dc7c00, rc 0) 00000100:00100000:1.0:1788841376.569573:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b491d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fbb75a7f-409e-496d-8433-a98f63f91f81+7:2400:x1875735392462080:12345-192.168.204.7@tcp:101:lhsmtool_posix.0 Request processed in 338us (3350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841376.569592:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 27 00000100:00100000:2.0:1788841376.573232:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:1.0:1788841376.573360:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392462336 00000100:00100000:1.0:1788841376.573738:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392462336 00000100:00100000:1.0:1788841376.574899:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 60 00000100:00100000:1.0:1788841376.574924:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b491d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fbb75a7f-409e-496d-8433-a98f63f91f81+36:18854:x1875735392462336:12345-192.168.204.7@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788841376.575092:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b491d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fbb75a7f-409e-496d-8433-a98f63f91f81+36:18854:x1875735392462336:12345-192.168.204.7@tcp:57:lhsmtool_posix.0 Request processed in 179us (1875us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841376.575101:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 60 00000100:00100000:3.0:1788841376.580657:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:2.0:1788841376.580874:0:25016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392462464 00000100:00100000:2.0:1788841376.580891:0:25016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392462464 00000100:00100000:2.0:1788841376.580972:0:25016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 61 00000100:00100000:2.0:1788841376.580985:0:25016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7cb87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fbb75a7f-409e-496d-8433-a98f63f91f81+36:18854:x1875735392462464:12345-192.168.204.7@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788841376.592859:0:22752:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000004:00080000:3.0:1788841376.592900:0:22752:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:3.0:1788841376.592985:0:22752:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000100:00100000:2.0:1788841376.593714:0:25016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7cb87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fbb75a7f-409e-496d-8433-a98f63f91f81+19:18854:x1875735392462464:12345-192.168.204.7@tcp:44:lhsmtool_posix.0 Request processed in 12722us (13140us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841376.593729:0:25016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 61 00010000:00010000:0.0:1788841376.595094:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc7200/0x5757cd208ac38712 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841376.595114:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc7200/0x5757cd208ac38712 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841376.595145:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc7200/0x5757cd208ac38712 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841376.595152:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b48dc7200 already unused, calling callback (ffffffffc17b44f0) 00010000:00010000:0.0:1788841376.595158:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc7200/0x5757cd208ac38712 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841376.595169:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc7200/0x5757cd208ac38712 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841376.595191:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa04b558f7000) 00010000:00010000:0.0:1788841376.595195:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1788841376.595202:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc7200/0x5757cd208ac38712 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841376.595208:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc7200/0x5757cd208ac38712 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841376.596380:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b491d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875735413546240:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788841376.596685:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841376.597353:0:24279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413546240 00000100:00100000:0.0:1788841376.597382:0:24279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413546240 00000100:00100000:0.0:1788841376.597471:0:24279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788841376.597491:0:24279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7cb87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875735413546240:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788841376.597711:0:24279:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788841376.597714:0:24279:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1788841376.597717:0:24279:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788841376.597719:0:24279:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788841375 -> 1788841375 00002000:00010000:0.0:1788841376.597721:0:24279:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1788841376.597799:0:24279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7cb87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3650:x1875735413546240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 310us (1114us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1788841376.597829:0:24279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1788841376.598795:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1788841376.599932:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa04b491d3800/2, rc 0, transno 12884901892 00000100:00100000:3.0:1788841376.599951:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b491d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875735413546240:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788841376.600269:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:3.0:1788841376.600618:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392462592 00000100:00100000:3.0:1788841376.600628:0:24278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392462592 00000100:00100000:3.0:1788841376.600736:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 29 00000100:00100000:3.0:1788841376.600749:0:24278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b41324000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fbb75a7f-409e-496d-8433-a98f63f91f81+7:2401:x1875735392462592:12345-192.168.204.7@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788841376.600933:0:24278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b41324000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fbb75a7f-409e-496d-8433-a98f63f91f81+7:2401:x1875735392462592:12345-192.168.204.7@tcp:16:lhsmtool_posix.0 Request processed in 184us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841376.600956:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 29 00010000:00010000:1.0:1788841376.601072:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4800/0x5757cd208ac386be lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.601086:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4800/0x5757cd208ac386be lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.601103:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4800/0x5757cd208ac386be lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.601110:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b7f8c4800 already unused, calling callback (ffffffffc17b44f0) 00010000:00010000:1.0:1788841376.601116:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4800/0x5757cd208ac386be lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.601125:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4800/0x5757cd208ac386be lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.601147:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffffa04b558f7d00) 00010000:00010000:1.0:1788841376.601151:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788841376.601156:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4800/0x5757cd208ac386be lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.601162:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4800/0x5757cd208ac386be lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.601185:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c5000/0x5757cd208ac386c5 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.601191:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c5000/0x5757cd208ac386c5 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.601196:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c5000/0x5757cd208ac386c5 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.601200:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b7f8c5000 already unused, calling callback (ffffffffc17b44f0) 00010000:00010000:1.0:1788841376.601203:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c5000/0x5757cd208ac386c5 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.601219:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c5000/0x5757cd208ac386c5 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.601227:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa04b558f7000) 00010000:00010000:1.0:1788841376.601230:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788841376.601233:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c5000/0x5757cd208ac386c5 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.601239:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c5000/0x5757cd208ac386c5 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.601254:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750be00/0x5757cd208ac3876d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.601260:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750be00/0x5757cd208ac3876d lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.601267:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750be00/0x5757cd208ac3876d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.601273:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04a4750be00 already unused, calling callback (ffffffffc17b44f0) 00010000:00010000:1.0:1788841376.601276:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750be00/0x5757cd208ac3876d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.601282:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750be00/0x5757cd208ac3876d lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.601290:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffffa04a46a6c700) 00010000:00010000:1.0:1788841376.601292:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788841376.601295:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750be00/0x5757cd208ac3876d lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.601306:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750be00/0x5757cd208ac3876d lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.601322:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4400/0x5757cd208ac387f2 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.601339:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4400/0x5757cd208ac387f2 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.601345:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4400/0x5757cd208ac387f2 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.601351:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b7f8c4400 already unused, calling callback (ffffffffc17b44f0) 00010000:00010000:1.0:1788841376.601354:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4400/0x5757cd208ac387f2 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.601360:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4400/0x5757cd208ac387f2 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.601368:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa04a46a6ca00) 00010000:00010000:1.0:1788841376.601381:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788841376.601384:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4400/0x5757cd208ac387f2 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.601391:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b7f8c4400/0x5757cd208ac387f2 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.601403:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6400/0x5757cd208ac38869 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.601409:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6400/0x5757cd208ac38869 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.601421:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6400/0x5757cd208ac38869 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.601427:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b48dc6400 already unused, calling callback (ffffffffc17b44f0) 00010000:00010000:1.0:1788841376.601429:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6400/0x5757cd208ac38869 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.601436:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6400/0x5757cd208ac38869 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.601444:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffffa04b558f7400) 00010000:00010000:1.0:1788841376.601447:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788841376.601450:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6400/0x5757cd208ac38869 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.601465:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6400/0x5757cd208ac38869 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841376.605007:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:1.0:1788841376.605173:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392462848 00000100:00100000:1.0:1788841376.605186:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392462848 00000100:00100000:1.0:1788841376.605257:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 62 00000100:00100000:1.0:1788841376.605270:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6e05ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fbb75a7f-409e-496d-8433-a98f63f91f81+15:18854:x1875735392462848:12345-192.168.204.7@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788841376.605363:0:22772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788841376.605603:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67521800/0x5757cd208ac3887e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53bb6 expref: 15 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.605628:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffffa04b558f7400) 00010000:00010000:1.0:1788841376.605634:0:22772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788841376.605693:0:22772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6c00/0x5757cd208ac3888c lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.605710:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6c00/0x5757cd208ac3888c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.605721:0:22772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6c00/0x5757cd208ac3888c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788841376.605928:0:22772:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000887deb5 reply state 000000004d7695eb transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6c00/0x5757cd208ac3888c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.605944:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6c00/0x5757cd208ac3888c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.605951:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffffa04b558f7400) 00010000:00010000:1.0:1788841376.605954:0:22772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788841376.605957:0:22772:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788841376.606763:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6e05ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fbb75a7f-409e-496d-8433-a98f63f91f81+16:18854:x1875735392462848:12345-192.168.204.7@tcp:36:lhsmtool_posix.0 Request processed in 1489us (1766us total) trans 12884901911 rc 0/0 00000100:00100000:1.0:1788841376.606775:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 62 00000100:00100000:0.0:1788841376.612627:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:1.0:1788841376.612744:0:24279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392462976 00000100:00100000:1.0:1788841376.612757:0:24279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392462976 00000100:00100000:1.0:1788841376.612953:0:24279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 30 00000100:00100000:1.0:1788841376.612965:0:24279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6d9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fbb75a7f-409e-496d-8433-a98f63f91f81+7:2401:x1875735392462976:12345-192.168.204.7@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788841376.613209:0:24279:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788841376.613214:0:24279:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1788841374 00002000:00010000:1.0:1788841376.613217:0:24279:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1788841374 00002000:00010000:1.0:1788841376.613220:0:24279:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788841375 -> 1788841374 00002000:00010000:1.0:1788841376.613222:0:24279:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1788841376.613413:0:24279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6d9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fbb75a7f-409e-496d-8433-a98f63f91f81+8:2401:x1875735392462976:12345-192.168.204.7@tcp:2:lhsmtool_posix.0 Request processed in 449us (801us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1788841376.613423:0:24279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 30 00000100:00100000:1.0:1788841376.618157:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:2.0:1788841376.618222:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392463104 00000100:00100000:2.0:1788841376.618246:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392463104 00000100:00100000:2.0:1788841376.618336:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 31 00000100:00100000:2.0:1788841376.618351:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7d5b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fbb75a7f-409e-496d-8433-a98f63f91f81+8:2400:x1875735392463104:12345-192.168.204.7@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788841376.618438:0:24277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000000ecff7b/0x5757cd208ac38893 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841376.618482:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788841376.618489:0:24277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788841376.618496:0:24277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000ecff7b/0x5757cd208ac38893 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841376.618515:0:24277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000ecff7b/0x5757cd208ac38893 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841376.618578:0:24277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000000ecff7b/0x5757cd208ac38893 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841376.618588:0:24277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000ecff7b/0x5757cd208ac38893 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841376.618598:0:24277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000ecff7b/0x5757cd208ac38893 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841376.618607:0:24277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b67521200 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:2.0:1788841376.618612:0:24277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000ecff7b/0x5757cd208ac38893 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841376.618623:0:24277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000ecff7b/0x5757cd208ac38893 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841376.618641:0:24277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000ecff7b/0x5757cd208ac38893 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841376.618649:0:24277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000ecff7b/0x5757cd208ac38893 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841376.619869:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7d5b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fbb75a7f-409e-496d-8433-a98f63f91f81+8:2400:x1875735392463104:12345-192.168.204.7@tcp:1:lhsmtool_posix.0 Request processed in 1507us (1713us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841376.619901:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 31 00000100:00100000:1.0:1788841376.625352:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:2.0:1788841376.626750:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392463360 00000100:00100000:2.0:1788841376.626765:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392463360 00000100:00100000:2.0:1788841376.626905:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 63 00000100:00100000:2.0:1788841376.626918:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7d5b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fbb75a7f-409e-496d-8433-a98f63f91f81+16:18854:x1875735392463360:12345-192.168.204.7@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788841376.627025:0:22773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67521200/0x5757cd208ac3889a lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841376.627048:0:22773:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2400/0x5757cd208ac387eb lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b85 expref: 16 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841376.627070:0:22773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67521200/0x5757cd208ac3889a lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841376.627128:0:22773:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2400/0x5757cd208ac387eb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b85 expref: 16 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841376.627147:0:22773:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2400/0x5757cd208ac387eb lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b85 expref: 16 pid: 22772 timeout: 910 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841376.627164:0:22773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b527ba680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22773:1875735413546368:192.168.204.7@tcp:104: 00000100:00100000:2.0:1788841376.627290:0:22773:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b6e1dae40 going to sleep for 11 seconds 00000100:00100000:2.0:1788841376.632799:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:1.0:1788841376.633057:0:22773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b527ba680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22773:1875735413546368:192.168.204.7@tcp:104: 00010000:00010000:1.0:1788841376.633098:0:22773:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67521200/0x5757cd208ac3889a lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841376.633614:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392463488 00000100:00100000:3.0:1788841376.633626:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392463488 00010000:00010000:3.0:1788841376.633679:0:22757:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2400/0x5757cd208ac387eb lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b85 expref: 17 pid: 22772 timeout: 910 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841376.633726:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 19 00000100:00100000:3.0:1788841376.633737:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b527b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fbb75a7f-409e-496d-8433-a98f63f91f81+17:2400:x1875735392463488:12345-192.168.204.7@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788841376.633758:0:22757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788841376.633766:0:22757:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2400/0x5757cd208ac387eb lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b85 expref: 17 pid: 22772 timeout: 910 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841376.633781:0:22757:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2400/0x5757cd208ac387eb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b85 expref: 17 pid: 22772 timeout: 910 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841376.633811:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb2400/0x5757cd208ac387eb lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b85 expref: 17 pid: 22772 timeout: 910 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841376.633885:0:22757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa04a46a6ca00) 00010000:00010000:3.0:1788841376.633892:0:22757:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3c00/0x5757cd208ac38807 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b93 expref: 16 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841376.633903:0:22757:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67521200/0x5757cd208ac3889a lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841376.633910:0:22757:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67521200/0x5757cd208ac3889a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841376.633939:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67521200/0x5757cd208ac3889a lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841376.633965:0:22757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788841376.634036:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b527b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fbb75a7f-409e-496d-8433-a98f63f91f81+16:2400:x1875735392463488:12345-192.168.204.7@tcp:103:ldlm_bl.0 Request processed in 300us (1254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841376.634045:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 19 00010000:00010000:1.0:1788841376.634251:0:22773:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67521200/0x5757cd208ac3889a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.634260:0:22773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67521200/0x5757cd208ac3889a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.634692:0:22773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6400/0x5757cd208ac388a1 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.634709:0:22773:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67521400/0x5757cd208ac38870 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53baf expref: 16 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.634719:0:22773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6400/0x5757cd208ac388a1 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.634759:0:22773:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67521400/0x5757cd208ac38870 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.7@tcp remote: 0x56167be89bd53baf expref: 16 pid: 22773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.634777:0:22773:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67521400/0x5757cd208ac38870 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.7@tcp remote: 0x56167be89bd53baf expref: 16 pid: 22773 timeout: 910 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841376.634808:0:22773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7d5b4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22773:1875735413546496:192.168.204.7@tcp:104: 00000100:00100000:1.0:1788841376.634933:0:22773:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b7fa47d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788841376.640003:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:1.0:1788841376.640547:0:22773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7d5b4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22773:1875735413546496:192.168.204.7@tcp:104: 00010000:00010000:1.0:1788841376.640587:0:22773:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6400/0x5757cd208ac388a1 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841376.641765:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392463616 00000100:00100000:0.0:1788841376.641782:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392463616 00010000:00010000:0.0:1788841376.641895:0:22759:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67521400/0x5757cd208ac38870 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.7@tcp remote: 0x56167be89bd53baf expref: 17 pid: 22773 timeout: 910 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788841376.641945:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 20 00000100:00100000:0.0:1788841376.641957:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7cb84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fbb75a7f-409e-496d-8433-a98f63f91f81+17:2401:x1875735392463616:12345-192.168.204.7@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788841376.641978:0:22759:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788841376.641986:0:22759:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67521400/0x5757cd208ac38870 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.7@tcp remote: 0x56167be89bd53baf expref: 17 pid: 22773 timeout: 910 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841376.642003:0:22759:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67521400/0x5757cd208ac38870 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.7@tcp remote: 0x56167be89bd53baf expref: 17 pid: 22773 timeout: 910 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841376.642032:0:22759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67521400/0x5757cd208ac38870 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.7@tcp remote: 0x56167be89bd53baf expref: 17 pid: 22773 timeout: 910 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841376.642658:0:22759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffffa04b558f7400) 00010000:00010000:0.0:1788841376.642665:0:22759:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6400/0x5757cd208ac388a1 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841376.642677:0:22759:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6400/0x5757cd208ac388a1 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841376.642686:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6400/0x5757cd208ac388a1 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.642878:0:22773:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6400/0x5757cd208ac388a1 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.642887:0:22773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6400/0x5757cd208ac388a1 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788841376.643066:0:22773:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:1.0:1788841376.643224:0:22773:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:1.0:1788841376.643268:0:22773:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00010000:00010000:0.0:1788841376.643365:0:22759:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788841376.643384:0:22773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7d5b4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22773:1875735413546624:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788841376.643490:0:22773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841376.643535:0:22773:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b7ddb0000 going to sleep for 11 seconds 00000100:00100000:3.0:1788841376.643595:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413546624 00000100:00100000:3.0:1788841376.643604:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413546624 00000100:00100000:3.0:1788841376.643666:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788841376.643677:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7d5b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22773:x1875735413546624:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788841376.643783:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7d5b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22773:x1875735413546624:12345-0@lo:1000:mdt00_001.0 Request processed in 106us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841376.643791:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788841376.644172:0:22773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7d5b4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22773:1875735413546624:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788841376.645642:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7cb84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fbb75a7f-409e-496d-8433-a98f63f91f81+19:2401:x1875735392463616:12345-192.168.204.7@tcp:103:ldlm_bl.0 Request processed in 3266us (5234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841376.645660:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 20 00000001:00080000:1.0:1788841376.646900:0:22773:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:1.0:1788841376.647029:0:22773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7d5b4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22773:1875735413546752:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788841376.647112:0:22773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841376.647155:0:22773:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b7fa47300 going to sleep for 11 seconds 00000100:00100000:3.0:1788841376.647723:0:22777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413546752 00000100:00100000:3.0:1788841376.647739:0:22777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413546752 00000100:00100000:3.0:1788841376.647822:0:22777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788841376.647911:0:22777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7d5b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22773:x1875735413546752:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788841376.652361:0:22777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7d5b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22773:x1875735413546752:12345-0@lo:1000:mdt00_001.0 Request processed in 4512us (5232us total) trans 12884901894 rc 0/0 00000100:00100000:0.0:1788841376.652384:0:22777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788841376.652976:0:22773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7d5b4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22773:1875735413546752:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1788841376.653133:0:22773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6400/0x5757cd208ac388a1 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.653168:0:22773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6400/0x5757cd208ac388a1 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.653177:0:22773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6400/0x5757cd208ac388a1 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.653183:0:22773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b48dc6400 already unused, calling callback (ffffffffc17b44f0) 00010000:00010000:1.0:1788841376.653189:0:22773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6400/0x5757cd208ac388a1 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.653198:0:22773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6400/0x5757cd208ac388a1 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.653219:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffffa04b558f7400) 00010000:00010000:1.0:1788841376.653223:0:22773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788841376.653305:0:22773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6400/0x5757cd208ac388a1 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.653313:0:22773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6400/0x5757cd208ac388a1 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.653375:0:22773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3600/0x5757cd208ac38800 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.653382:0:22773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3600/0x5757cd208ac38800 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.653480:0:22773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3600/0x5757cd208ac38800 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.653486:0:22773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b67bb3600 already unused, calling callback (ffffffffc17b44f0) 00010000:00010000:1.0:1788841376.653496:0:22773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3600/0x5757cd208ac38800 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.653503:0:22773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3600/0x5757cd208ac38800 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.653513:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa04a46a6ca00) 00010000:00010000:1.0:1788841376.653516:0:22773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788841376.653524:0:22773:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3c00/0x5757cd208ac38807 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b93 expref: 19 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.653538:0:22773:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3c00/0x5757cd208ac38807 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b93 expref: 19 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.653549:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3c00/0x5757cd208ac38807 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b93 expref: 19 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.653637:0:22773:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3c00/0x5757cd208ac38807 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53b93 expref: 19 pid: 22772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841376.653654:0:22773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7d5b6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22773:1875735413546880:192.168.204.7@tcp:105: 00000100:00100000:1.0:1788841376.653873:0:22773:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b6e035780 going to sleep for 11 seconds 00000100:00100000:3.0:1788841376.660608:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:2.0:1788841376.660689:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392463744 00000100:00100000:2.0:1788841376.660702:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392463744 00000100:00100000:2.0:1788841376.660780:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 10 00000100:00100000:2.0:1788841376.660792:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7c1e3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fbb75a7f-409e-496d-8433-a98f63f91f81+20:18853:x1875735392463744:12345-192.168.204.7@tcp:49:dd.0 00000100:00100000:2.0:1788841376.661011:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7c1e3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fbb75a7f-409e-496d-8433-a98f63f91f81+20:18853:x1875735392463744:12345-192.168.204.7@tcp:49:dd.0 Request processed in 222us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841376.661019:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 10 00000100:00100000:1.0:1788841376.662650:0:22773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7d5b6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22773:1875735413546880:192.168.204.7@tcp:105: 00010000:00010000:1.0:1788841376.662693:0:22773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3600/0x5757cd208ac38800 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.662706:0:22773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67bb3600/0x5757cd208ac38800 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 25016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.662963:0:22773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6a00/0x5757cd208ac388a8 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.662983:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6a00/0x5757cd208ac388a8 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.662998:0:22773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6a00/0x5757cd208ac388a8 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.663011:0:22773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6a00/0x5757cd208ac388a8 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.663018:0:22773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6a00/0x5757cd208ac388a8 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.663025:0:22773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6a00/0x5757cd208ac388a8 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.663032:0:22773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b48dc6a00 already unused, calling callback (ffffffffc17b44f0) 00010000:00010000:1.0:1788841376.663037:0:22773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6a00/0x5757cd208ac388a8 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.663045:0:22773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6a00/0x5757cd208ac388a8 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.663058:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa04a46a6ca00) 00010000:00010000:1.0:1788841376.663061:0:22773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788841376.663065:0:22773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6a00/0x5757cd208ac388a8 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.663071:0:22773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b48dc6a00/0x5757cd208ac388a8 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.663090:0:22773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67521200/0x5757cd208ac3889a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.663096:0:22773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67521200/0x5757cd208ac3889a lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.663102:0:22773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67521200/0x5757cd208ac3889a lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.663108:0:22773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b67521200 already unused, calling callback (ffffffffc17b44f0) 00010000:00010000:1.0:1788841376.663111:0:22773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67521200/0x5757cd208ac3889a lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.663117:0:22773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67521200/0x5757cd208ac3889a lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.663125:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa04a46a6ca00) 00010000:00010000:1.0:1788841376.663128:0:22773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788841376.663130:0:22773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67521200/0x5757cd208ac3889a lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.663136:0:22773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67521200/0x5757cd208ac3889a lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841376.663674:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7d5b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fbb75a7f-409e-496d-8433-a98f63f91f81+19:18854:x1875735392463360:12345-192.168.204.7@tcp:57:lhsmtool_posix.0 Request processed in 36752us (38341us total) trans 12884901916 rc 0/0 00000100:00100000:1.0:1788841376.663686:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 63 00000020:00080000:1.0:1788841376.663695:0:22773:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788841376.664365:0:22808:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788841376.664372:0:22808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788841376.664508:0:22808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1788841376.664517:0:22808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1788841376.669220:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:3.0:1788841376.669261:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:0.0:1788841376.669768:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392463872 00000100:00100000:0.0:1788841376.669783:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392463872 00000100:00100000:0.0:1788841376.669903:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 64 00000100:00100000:0.0:1788841376.669915:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7cb86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fbb75a7f-409e-496d-8433-a98f63f91f81+19:18853:x1875735392463872:12345-192.168.204.7@tcp:101:dd.0 00010000:00010000:0.0:1788841376.669944:0:22774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788841376.669973:0:22774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750aa00/0x5757cd208ac388af lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x56167be89bd53bc4 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841376.670022:0:22774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750a200/0x5757cd208ac388b6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841376.670041:0:22774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750a200/0x5757cd208ac388b6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841376.670054:0:22774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750a200/0x5757cd208ac388b6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841376.670235:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750aa00/0x5757cd208ac388af lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53bc4 expref: 21 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841376.670256:0:22774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa04a4750a200/0x5757cd208ac388b6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53bc4 expref: 20 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841376.670266:0:22774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa04a46a6ca00) 00010000:00010000:0.0:1788841376.670269:0:22774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788841376.670273:0:22774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa04a4750a200, rc 0) 00000100:00100000:0.0:1788841376.670366:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7cb86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fbb75a7f-409e-496d-8433-a98f63f91f81+20:18853:x1875735392463872:12345-192.168.204.7@tcp:101:dd.0 Request processed in 453us (1164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841376.670374:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 64 00000100:00100000:2.0:1788841376.671440:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392464128 00000100:00100000:2.0:1788841376.671453:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392464128 00000100:00100000:2.0:1788841376.671558:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 11 00000100:00100000:2.0:1788841376.671579:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7cb86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fbb75a7f-409e-496d-8433-a98f63f91f81+20:18854:x1875735392464128:12345-192.168.204.7@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788841376.672043:0:22775:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788841376.672088:0:22775:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:2.0:1788841376.672126:0:22775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67520400/0x5757cd208ac388bd lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841376.672147:0:22775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67520400/0x5757cd208ac388bd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841376.672161:0:22775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67520400/0x5757cd208ac388bd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841376.672172:0:22775:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67520400/0x5757cd208ac388bd lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841376.672192:0:22775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67520400/0x5757cd208ac388bd lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841376.672199:0:22775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67520400/0x5757cd208ac388bd lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841376.672267:0:22775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788841376.672396:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7cb86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fbb75a7f-409e-496d-8433-a98f63f91f81+22:18854:x1875735392464128:12345-192.168.204.7@tcp:35:lhsmtool_posix.0 Request processed in 828us (3132us total) trans 12884901918 rc 0/0 00000100:00100000:2.0:1788841376.672426:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 11 00000020:00080000:2.0:1788841376.672432:0:22775:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788841376.674484:0:22761:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788841376.674503:0:22761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67520400/0x5757cd208ac388bd lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841376.674518:0:22761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b67520400 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:0.0:1788841376.674523:0:22761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67520400/0x5757cd208ac388bd lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841376.674534:0:22761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67520400/0x5757cd208ac388bd lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841376.674558:0:22761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffffa04b558f7400) 00010000:00010000:0.0:1788841376.674561:0:22761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788841376.674568:0:22761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67520400/0x5757cd208ac388bd lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841376.674702:0:22761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa04b67520400/0x5757cd208ac388bd lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788841376.674724:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841376.674726:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788841376.674728:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788841376.783783:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788841376.783814:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7cb84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875735413547008:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788841376.783947:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841376.784165:0:24282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413547008 00000100:00100000:1.0:1788841376.784175:0:24282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413547008 00000100:00100000:1.0:1788841376.784290:0:24282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788841376.784302:0:24282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b527b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875735413547008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788841376.784360:0:24282:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788841376.784419:0:24282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b527b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875735413547008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 120us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841376.784426:0:24282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788841376.784482:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7cb84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875735413547008:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788841376.784753:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788841376.918132:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:0.0:1788841376.921093:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:2.0:1788841376.921191:0:24284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392464256 00000100:00100000:2.0:1788841376.921201:0:24284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392464256 00000100:00100000:2.0:1788841376.921274:0:24284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392464384 00000100:00100000:2.0:1788841376.921277:0:24284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392464384 00000100:00100000:2.0:1788841376.921298:0:24284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 0 00000100:00100000:2.0:1788841376.921308:0:24284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7cb84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fbb75a7f-409e-496d-8433-a98f63f91f81+9:2400:x1875735392464256:12345-192.168.204.7@tcp:4:dd.0 00010000:00010000:2.0:1788841376.921352:0:24284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001696e35f/0x5757cd208ac388c4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841376.921373:0:24284:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000005695be/0x5757cd208ac38885 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.7@tcp remote: 0x56167be89bd53bbd expref: 9 pid: 24277 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841376.921382:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788841376.921387:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788841376.921392:0:24284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001696e35f/0x5757cd208ac388c4 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841376.921429:0:24284:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000005695be/0x5757cd208ac38885 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.7@tcp remote: 0x56167be89bd53bbd expref: 9 pid: 24277 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841376.921456:0:24284:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000005695be/0x5757cd208ac38885 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.7@tcp remote: 0x56167be89bd53bbd expref: 9 pid: 24277 timeout: 911 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841376.921489:0:24284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b527b8000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0000_UUID:24284:1875735413547136:192.168.204.7@tcp:104: 00000100:00100000:2.0:1788841376.921572:0:24284:0:(client.c:2715:ptlrpc_set_wait()) set ffffa04b6e1dacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788841376.928130:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.7@tcp (source: 12345-192.168.204.7@tcp) 00000100:00100000:1.0:1788841376.929596:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735392464512 00000100:00100000:1.0:1788841376.929609:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735392464512 00010000:00010000:1.0:1788841376.929663:0:22758:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000005695be/0x5757cd208ac38885 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.7@tcp remote: 0x56167be89bd53bbd expref: 10 pid: 24277 timeout: 911 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841376.929723:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 21 00000100:00100000:1.0:1788841376.929734:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7f88ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fbb75a7f-409e-496d-8433-a98f63f91f81+10:2400:x1875735392464512:12345-192.168.204.7@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788841376.929750:0:22758:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788841376.929776:0:22758:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000005695be/0x5757cd208ac38885 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.7@tcp remote: 0x56167be89bd53bbd expref: 10 pid: 24277 timeout: 911 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.929793:0:22758:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000005695be/0x5757cd208ac38885 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.7@tcp remote: 0x56167be89bd53bbd expref: 10 pid: 24277 timeout: 911 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.929822:0:22758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788841376.929827:0:22758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788841376.929860:0:22758:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001696e35f/0x5757cd208ac388c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.929888:0:22758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001696e35f/0x5757cd208ac388c4 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841376.929910:0:22758:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788841376.929973:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7f88ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fbb75a7f-409e-496d-8433-a98f63f91f81+10:2400:x1875735392464512:12345-192.168.204.7@tcp:103:ldlm_bl.0 Request processed in 240us (1852us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841376.929981:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 21 00010000:00010000:2.0:1788841376.938174:0:24284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000005695be/0x5757cd208ac38885 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.7@tcp remote: 0x56167be89bd53bbd expref: 9 pid: 24277 timeout: 911 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788841376.938202:0:24284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b527b8000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0000_UUID:24284:1875735413547136:192.168.204.7@tcp:104: 00010000:00010000:2.0:1788841376.938240:0:24284:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001696e35f/0x5757cd208ac388c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841376.938254:0:24284:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001696e35f/0x5757cd208ac388c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841376.938262:0:24284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001696e35f/0x5757cd208ac388c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788841377.025519:0:24274:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901895 is committed 00000001:00080000:2.0:1788841377.025549:0:24274:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901894 is committed 00002000:00010000:3.0:1788841377.025932:0:24284:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:3.0:1788841377.025938:0:24284:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 1788841374 -> 1788841375 00002000:00010000:3.0:1788841377.025941:0:24284:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788841374 -> 1788841375 00002000:00010000:3.0:1788841377.025966:0:24284:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:3.0:1788841377.026204:0:24284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001696e35f/0x5757cd208ac388c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841377.026224:0:24284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001696e35f/0x5757cd208ac388c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841377.026234:0:24284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001696e35f/0x5757cd208ac388c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841377.026242:0:24284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b67520600 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:3.0:1788841377.026248:0:24284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001696e35f/0x5757cd208ac388c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841377.026258:0:24284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001696e35f/0x5757cd208ac388c4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841377.026286:0:24284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001696e35f/0x5757cd208ac388c4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841377.026294:0:24284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001696e35f/0x5757cd208ac388c4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788841377.026580:0:24284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7cb84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fbb75a7f-409e-496d-8433-a98f63f91f81+6:2400:x1875735392464256:12345-192.168.204.7@tcp:4:dd.0 Request processed in 105264us (108448us total) trans 12884901895 rc 0/0 00000100:00100000:3.0:1788841377.026598:0:24284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 0 00000100:00100000:3.0:1788841377.026643:0:24284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.7@tcp, seq: 1 00000100:00100000:3.0:1788841377.026658:0:24284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6d9f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fbb75a7f-409e-496d-8433-a98f63f91f81+5:2400:x1875735392464384:12345-192.168.204.7@tcp:4:dd.0 00002000:00010000:3.0:1788841377.026726:0:24284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 4194304, mtime: 0x6a9f8d9f, atime: 0x6a9f8d9e, ctime: 0x6a9f8d9f, blocks: 0x2000 00010000:00010000:3.0:1788841377.026734:0:24284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079c13099/0x5757cd208ac388cb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841377.026749:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=811s v=(0 0) 00010000:00010000:3.0:1788841377.026755:0:24284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788841377.026763:0:24284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079c13099/0x5757cd208ac388cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788841377.026777:0:24284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079c13099/0x5757cd208ac388cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788841377.101011:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788841377.114351:0:24274:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901896 is committed 00002000:00010000:1.0:1788841377.114825:0:24284:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:1.0:1788841377.114855:0:24284:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:1.0:1788841377.114879:0:24284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079c13099/0x5757cd208ac388cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841377.114896:0:24284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079c13099/0x5757cd208ac388cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841377.114907:0:24284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079c13099/0x5757cd208ac388cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841377.114915:0:24284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa04b7f8c4c00 already unused, calling callback (ffffffffc0b95420) 00010000:00010000:1.0:1788841377.114922:0:24284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079c13099/0x5757cd208ac388cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841377.114933:0:24284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079c13099/0x5757cd208ac388cb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841377.114963:0:24284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079c13099/0x5757cd208ac388cb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788841377.114995:0:24284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079c13099/0x5757cd208ac388cb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788841377.115193:0:24284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6d9f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fbb75a7f-409e-496d-8433-a98f63f91f81+5:2400:x1875735392464384:12345-192.168.204.7@tcp:4:dd.0 Request processed in 88531us (194100us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1788841377.115211:0:24284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.7@tcp, seq: 1 00000100:00100000:1.0:1788841377.293351:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b6d9f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875735413547264:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788841377.293471:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841377.293869:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413547264 00000100:00100000:0.0:1788841377.293882:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413547264 00000100:00100000:0.0:1788841377.293959:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788841377.293973:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7d5b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875735413547264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788841377.294023:0:22778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:0.0:1788841377.294099:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7d5b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875735413547264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 129us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841377.294107:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788841377.294355:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b6d9f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875735413547264:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788841377.295429:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788841377.295453:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7f88dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875735413547392:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788841377.295536:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841377.297139:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413547392 00000100:00100000:2.0:1788841377.297161:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413547392 00000100:00100000:2.0:1788841377.297261:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788841377.297275:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7d5b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875735413547392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788841377.297342:0:22778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788841377.297500:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7d5b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875735413547392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 227us (1962us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841377.297508:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788841377.297875:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7f88dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875735413547392:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788841377.806270:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788841377.806315:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7f88dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875735413547520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788841377.806416:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841377.808415:0:24282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413547520 00000100:00100000:1.0:1788841377.808436:0:24282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413547520 00000100:00100000:1.0:1788841377.808532:0:24282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788841377.808545:0:24282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7f88f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875735413547520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788841377.808591:0:24282:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788841377.808706:0:24282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7f88f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875735413547520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 163us (2292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841377.808714:0:24282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788841377.808769:0:3649:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901894 gen 2 00000004:00080000:3.0:1788841377.808779:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa04b491d3800, transno 12884901892 00000004:00080000:3.0:1788841377.808800:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901894 committed transno 12884901894 00000100:00100000:3.0:1788841377.808873:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7f88dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875735413547520:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788841378.131011:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788841378.703591:0:22808:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788841378.703615:0:22808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788841378.703650:0:22808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1788841378.703660:0:22808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000001:02000400:3.0:1788841378.890383:0:25852:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1788841379.151766:0:22760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788841379.341112:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788841379.341147:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b527b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875735413547648:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788841379.341230:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788841379.341585:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413547648 00000100:00100000:3.0:1788841379.341595:0:24280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413547648 00000100:00100000:3.0:1788841379.341656:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788841379.341666:0:24280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7d5b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875735413547648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788841379.341710:0:24280:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788841379.341762:0:24280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7d5b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875735413547648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788841379.341770:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788841379.341824:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b527b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875735413547648:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788841379.342026:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788841379.342212:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b527b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a456da20-a415-4617-896c-ee7aa5e4c089:3652:1875735413547776:0@lo:400:kworker.0 00000100:00100000:0.0:1788841379.342251:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841379.342290:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b527bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875735413548288:0@lo:400:kworker.0 00000100:00100000:0.0:1788841379.342317:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841379.342338:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788841379.342354:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b527b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875735413548160:0@lo:400:kworker.0 00000100:00100000:0.0:1788841379.342379:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841379.342407:0:25016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413548288 00000100:00100000:0.0:1788841379.342412:0:25016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413548288 00000100:00100000:0.0:1788841379.342448:0:25016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788841379.342456:0:25016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6d9f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875735413548288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841379.342513:0:25016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6d9f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875735413548288:12345-0@lo:400:kworker.0 Request processed in 58us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841379.342520:0:25016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788841379.342552:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b527bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875735413548288:0@lo:400:kworker.0 00000100:00100000:0.0:1788841379.342588:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b527b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875735413547904:0@lo:400:kworker.0 00000100:00100000:0.0:1788841379.342614:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841379.342630:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b527bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875735413548416:0@lo:400:kworker.0 00000100:00100000:0.0:1788841379.342646:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841379.342661:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788841379.342665:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b527b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875735413548032:0@lo:400:kworker.0 00000100:00100000:0.0:1788841379.342684:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788841379.342715:0:24716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413548160 00000100:00100000:0.0:1788841379.342718:0:24716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413548160 00000100:00100000:0.0:1788841379.342744:0:24716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413548032 00000100:00100000:0.0:1788841379.342746:0:24716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413548032 00000100:00100000:0.0:1788841379.342762:0:24716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788841379.342768:0:24716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6d9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1875735413548160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841379.342797:0:24716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6d9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1875735413548160:12345-0@lo:400:kworker.0 Request processed in 29us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841379.342803:0:24716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788841379.342813:0:24716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788841379.342817:0:24716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6d9f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875735413548032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841379.342880:0:24716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6d9f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875735413548032:12345-0@lo:400:kworker.0 Request processed in 62us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841379.342886:0:24716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788841379.342918:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b527b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875735413548032:0@lo:400:kworker.0 00000100:00100000:0.0:1788841379.342939:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b527b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875735413548160:0@lo:400:kworker.0 00000100:00100000:0.0:1788841379.342958:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413547904 00000100:00100000:0.0:1788841379.342961:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413547904 00000100:00100000:0.0:1788841379.342976:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413548416 00000100:00100000:0.0:1788841379.342978:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413548416 00000100:00100000:0.0:1788841379.342987:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788841379.342991:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6d9f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875735413547904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841379.343022:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6d9f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875735413547904:12345-0@lo:400:kworker.0 Request processed in 30us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841379.343027:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788841379.343037:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788841379.343042:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b6d9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875735413548416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788841379.343062:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b6d9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875735413548416:12345-0@lo:400:kworker.0 Request processed in 20us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788841379.343067:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:0.0:1788841379.343078:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788841379.343080:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788841379.343092:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b527b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875735413547904:0@lo:400:kworker.0 00000100:00100000:0.0:1788841379.343100:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b527bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875735413548416:0@lo:400:kworker.0 00000100:00100000:2.0:1788841379.343416:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b527bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875735413548544:0@lo:400:kworker.0 00000100:00100000:2.0:1788841379.343449:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841379.343467:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b527bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1875735413549056:0@lo:400:kworker.0 00000100:00100000:2.0:1788841379.343487:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841379.343506:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788841379.343511:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b527ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1875735413548928:0@lo:400:kworker.0 00000100:00100000:2.0:1788841379.343530:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841379.343554:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413549056 00000100:00100000:2.0:1788841379.343558:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413549056 00000100:00100000:2.0:1788841379.343586:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413548928 00000100:00100000:2.0:1788841379.343589:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413548928 00000100:00100000:2.0:1788841379.343602:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788841379.343608:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b527baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875735413549056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841379.343641:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b527baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875735413549056:12345-0@lo:400:kworker.0 Request processed in 34us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841379.343646:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788841379.343658:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788841379.343663:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b527bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875735413548928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841379.343687:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b527bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875735413548928:12345-0@lo:400:kworker.0 Request processed in 24us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841379.343692:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:2.0:1788841379.343724:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa04b527ba300 x1875735413548928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841379.343749:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b527ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1875735413548928:0@lo:400:kworker.0 00000100:00100000:2.0:1788841379.343760:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b527bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1875735413549056:0@lo:400:kworker.0 00000100:00100000:2.0:1788841379.343779:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b527b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875735413548672:0@lo:400:kworker.0 00000100:00100000:2.0:1788841379.343801:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841379.343817:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b527b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875735413549184:0@lo:400:kworker.0 00000100:00100000:2.0:1788841379.343856:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841379.343882:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788841379.343887:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b527b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1875735413548800:0@lo:400:kworker.0 00000100:00100000:2.0:1788841379.343908:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788841379.343926:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413548672 00000100:00100000:2.0:1788841379.343928:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413548672 00000100:00100000:2.0:1788841379.343943:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413549184 00000100:00100000:2.0:1788841379.343945:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413549184 00000100:00100000:2.0:1788841379.343957:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413548800 00000100:00100000:2.0:1788841379.343959:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413548800 00000100:00100000:2.0:1788841379.343971:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788841379.343976:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b527bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875735413548672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841379.344007:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b527bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875735413548672:12345-0@lo:400:kworker.0 Request processed in 30us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841379.344013:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788841379.344024:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788841379.344031:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b527ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875735413549184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841379.344054:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b527ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875735413549184:12345-0@lo:400:kworker.0 Request processed in 24us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841379.344059:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788841379.344077:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788841379.344083:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b527b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875735413548800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841379.344109:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b527b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875735413548800:12345-0@lo:400:kworker.0 Request processed in 26us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841379.344114:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788841379.344592:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b527b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1875735413548800:0@lo:400:kworker.0 00000100:00100000:2.0:1788841379.344606:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b527b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875735413548672:0@lo:400:kworker.0 00010000:00080000:2.0:1788841379.344616:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa04b527b8a80 x1875735413549184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788841395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788841379.344626:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b527b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875735413549184:0@lo:400:kworker.0 00000100:00080000:2.0:1788841379.344648:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788841379.344652:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788841379.344668:0:24716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413548544 00000100:00100000:2.0:1788841379.344672:0:24716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413548544 00000100:00100000:2.0:1788841379.344716:0:24716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788841379.344723:0:24716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b527bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875735413548544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788841379.344762:0:24716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b527bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875735413548544:12345-0@lo:400:kworker.0 Request processed in 40us (1312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788841379.344770:0:24716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788841379.344797:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b527bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875735413548544:0@lo:400:kworker.0 00000100:00100000:1.0:1788841379.344955:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413547776 00000100:00100000:1.0:1788841379.344967:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413547776 00000100:00100000:1.0:1788841379.344996:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788841379.345003:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7060c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+24:3652:x1875735413547776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788841379.345037:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7060c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a456da20-a415-4617-896c-ee7aa5e4c089+24:3652:x1875735413547776:12345-0@lo:400:kworker.0 Request processed in 35us (2785us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841379.345043:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788841379.345086:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788841379.345095:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa04b7d5b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875735413549312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788841379.345122:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788841379.345167:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875735413549312 00000100:00100000:1.0:1788841379.345171:0:24280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875735413549312 00000100:00100000:1.0:1788841379.345195:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788841379.345200:0:24280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa04b7d5b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875735413549312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788841379.345215:0:24280:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788841379.345247:0:24280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa04b7d5b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875735413549312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788841379.345253:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788841379.345294:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b7d5b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875735413549312:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788841379.346287:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa04b527b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a456da20-a415-4617-896c-ee7aa5e4c089:3652:1875735413547776:0@lo:400:kworker.0 00000100:00080000:0.0:1788841379.346390:0:22768:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788841380.174696:0:22761:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 14505 lines, 14505 kept, 0 dropped, 0 bad.